Sep 23 00:05:34 devstack cinder-volume[75412]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:05:34 devstack cinder-volume[75412]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:05:34 devstack cinder-volume[75412]: we strongly recommend against using it for new projects. Sep 23 00:05:34 devstack cinder-volume[75412]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:05:34 devstack cinder-volume[75412]: framework. For more detail see Sep 23 00:05:34 devstack cinder-volume[75412]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:05:34 devstack cinder-volume[75412]: import eventlet # noqa Sep 23 00:05:37 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:05:37 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:05:37 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:05:38 devstack cinder-volume[75412]: INFO dbcounter [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Registered counter for database cinder Sep 23 00:05:38 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:38 devstack cinder-volume[75412]: DEBUG dbcounter [-] [75412] Writer thread running {{(pid=75412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:38 devstack cinder-volume[75412]: INFO cinder.rpc [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:05:38 devstack cinder-volume[75412]: INFO cinder.rpc [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:39 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Determined volume DB was empty at startup. Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG cinder.volume.manager [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75412) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:05:39 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:05:39 devstack cinder-volume[75412]: WARNING stevedore.named [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:05:39 devstack cinder-volume[75412]: WARNING castellan.key_manager [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:39 devstack cinder-volume[75412]: WARNING cinder.keymgr.conf_key_mgr [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG cinder.volume.drivers.lvm [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75412) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_concurrency.processutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_concurrency.processutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.520s {{(pid=75412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:39 devstack cinder-volume[75412]: INFO cinder.rpc [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 00:05:39 devstack cinder-volume[75412]: INFO cinder.rpc [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 00:05:39 devstack cinder-volume[75412]: WARNING stevedore.named [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:05:39 devstack cinder-volume[75412]: WARNING castellan.key_manager [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:39 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:39 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Starting 1 workers Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Started child 75586 {{(pid=75412) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Full set of CONF: {{(pid=75412) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] ******************************************************************************** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Configuration options gathered from: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] ================================================================================ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] allow_availability_zone_fallback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] allow_compression_on_image_upload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] allowed_direct_url_schemes = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75586]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] api_rate_limit = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] auth_strategy = keystone {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] az_cache_duration = 3600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_host = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_stats_polling_interval = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backup_api_class = cinder.backup.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backup_name_template = backup-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backup_use_same_host = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backup_use_temp_snapshot = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:39 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] chap_username = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_internal_tenant_project_id = 1a0d900e2936429485f61f5623116547 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_internal_tenant_user_id = 9532d7cd5b5742b8b1ca71558bb109f5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cloned_volume_same_az = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cluster = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] compression_format = gzip {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] compute_api_class = cinder.compute.nova.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] config_dir = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] config_source = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] control_exchange = openstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] debug = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] default_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] default_group_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] default_volume_type = lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] deployment_max_gigabytes = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] driver_ssl_cert_verify = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] driver_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] enable_force_upload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] enable_new_services = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] enable_unsupported_driver = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] enforce_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_api_insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_api_servers = ['http://192.168.122.145/image'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_api_ssl_compression = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_ca_certificates_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_catalog_info = image:glance:publicURL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_num_retries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance_request_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] graceful_shutdown_timeout = 5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] group_api_class = cinder.group.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] host = devstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_compress_on_upload = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_conversion_address_space_limit = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_conversion_cpu_limit = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_conversion_disable = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_introspection_address_space_limit = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_introspection_cpu_limit = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_upload_use_cinder_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_upload_use_internal_tenant = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_volume_cache_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_volume_cache_max_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] init_host_max_objects_retrieval = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] instance_format = [instance: %(uuid)s] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] iscsi_target_flags = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] iscsi_write_cache = on {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] iser_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] iser_ip_address = 192.168.122.145 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] iser_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_color = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_config_append = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_dir = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_options = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_rotate_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_rotate_interval_type = days {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] log_rotation_type = none {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] max_age = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] max_logfile_count = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] max_logfile_size_mb = 200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] max_over_subscription_ratio = 20.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] message_reap_interval = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] message_ttl = 2592000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] monkey_patch = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] monkey_patch_modules = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] my_ip = 192.168.122.145 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] no_snapshot_gb_quota = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] num_iser_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75586]: INFO cinder.volume.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] num_shell_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] num_volume_device_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] nvmeof_conn_info_version = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] nvmet_ns_id = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] nvmet_port_id = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_max_limit = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_volume_ext_list = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_volume_listen_port = 8776 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_volume_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] osapi_volume_workers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] per_volume_size_limit = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] periodic_fuzzy_delay = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] periodic_interval = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] public_endpoint = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] publish_errors = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_backup_gigabytes = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_backups = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_gigabytes = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_groups = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_snapshots = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] quota_volumes = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] rate_limit_burst = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] rate_limit_except_level = CRITICAL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] rate_limit_interval = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] reinit_driver_count = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] report_discard_supported = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] report_interval = 120 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] reservation_clean_interval = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] reservation_expire = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] reserved_image_namespaces = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] reserved_percentage = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] rpc_response_timeout = 120 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] run_external_periodic_tasks = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] scst_target_driver = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_down_time = 720 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] shell_completion = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] snapshot_name_template = snapshot-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] snapshot_same_host = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] state_path = /opt/stack/data/cinder {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] storage_availability_zone = nova {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] storage_protocol = iSCSI {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] syslog_log_facility = LOG_USER {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] target_helper = lioadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] target_ip_address = 192.168.122.145 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] target_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] target_secondary_ip_addresses = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] trace_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] transport_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] until_refresh = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_chap_auth = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_default_quota_class = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_journal = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_json = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_stderr = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] use_syslog = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] verify_glance_signatures = enabled {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_api_class = cinder.volume.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_clear = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_clear_size = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_copy_bps_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_dd_blocksize = 1M {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_name_template = volume-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_service_inithost_offload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volume_usage_audit_period = month {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] zoning_mode = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.auth_type = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.auth_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.cache = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.interface = public {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcache_username = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.service_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.145/identity {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.backend = dogpile.cache.null {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.backend_argument = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.backend_expiration_time = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.config_prefix = cache.oslo {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.debug_cache_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.enable_retry_client = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.enable_socket_keepalive = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.expiration_time = 600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_dead_retry = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_pool_maxsize = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_sasl_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.proxies = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.redis_db = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.redis_server = localhost:6379 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.retry_attempts = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.retry_delay = 0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.socket_keepalive_count = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.socket_keepalive_idle = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.socket_keepalive_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.socket_timeout = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.tls_allowed_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.tls_cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.tls_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.tls_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.tls_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cache.username = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] coordination.backend_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.asyncio_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.asyncio_slave_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.backend = sqlalchemy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.connection_debug = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.connection_parameters = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.connection_recycle_time = 3600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.connection_trace = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.db_inc_retry_interval = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.db_max_retries = 20 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.db_max_retry_interval = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.db_retry_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.max_overflow = 50 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.max_pool_size = 5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.max_retries = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.pool_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.retry_interval = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.slave_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.sqlite_synchronous = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.synchronous_reader = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] database.use_db_reconnect = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_tracing.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.connection_string = messaging:// {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.es_doc_type = notification {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.es_scroll_size = 10000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.es_scroll_time = 2m {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.filter_error_trace = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.hmac_keys = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.sentinel_service_name = mymaster {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.socket_timeout = 0.1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.trace_requests = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler.trace_sqlalchemy = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler_jaeger.process_tags = {} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] profiler_otlp.service_name_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.policy_default_rule = default {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.policy_file = policy.yaml {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.group = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.helper_command = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] privsep_osbrick.user = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.group = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.helper_command = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] cinder_sys_admin.user = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.auth_type = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.send_service_user_token = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] service_user.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.auth_type = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] glance.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.chap_username = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.driver_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.extra_capabilities = {} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.iscsi_target_flags = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.iser_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.iser_ip_address = 192.168.122.145 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.iser_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.lvm_share_target = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.lvm_type = auto {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.report_discard_supported = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.target_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.target_ip_address = 192.168.122.145 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.target_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.trace_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.use_chap_auth = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_clear = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack sudo[75590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_reports.file_event_handler = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_reports.log_dir = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.backend_host = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.chap_username = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.iser_helper = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.iser_ip_address = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.iser_port = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack sudo[75590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.lvm_share_target = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.lvm_type = auto {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.num_shell_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.storage_protocol = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.target_helper = lioadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.target_ip_address = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.target_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.trace_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.use_chap_auth = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_clear = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_clear_size = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] lvmdriver-1.volumes_dir = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_notifications.driver = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] key_manager.fixed_key = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.barbican_api_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.barbican_endpoint = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.barbican_endpoint_type = public {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.barbican_region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.number_of_retries = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.retry_delay = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.send_service_user_token = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.verify_ssl = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican.verify_ssl_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.auth_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] barbican_service_user.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.approle_role_id = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.approle_secret_id = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.auth_method = approle {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.auth_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.kv_mountpoint = secret {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.kv_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.kv_version = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.root_token_id = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.ssl_ca_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.timeout = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.token_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.token_role = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:40 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] ******************************************************************************** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:05:40 devstack sudo[75590]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack sudo[75661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:40 devstack sudo[75661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:40 devstack sudo[75661]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.286s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:05:40 devstack cinder-volume[75586]: INFO cinder.brick.local_dev.lvm [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:40 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:40 devstack sudo[75790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:40 devstack sudo[75790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:41 devstack sudo[75790]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG cinder.brick.local_dev.lvm [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75586) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:41 devstack sudo[75875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:41 devstack sudo[75875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:41 devstack sudo[75875]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:41 devstack sudo[76078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:41 devstack sudo[76078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:41 devstack sudo[76078]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:41 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:41 devstack sudo[76195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 00:05:41 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:42 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:42 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.291s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:42 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:42 devstack sudo[76198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:42 devstack sudo[76198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:42 devstack sudo[76198]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:42 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:42 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:42 devstack sudo[76281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:42 devstack sudo[76281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:42 devstack sudo[76281]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:42 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:42 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:42 devstack sudo[76284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:42 devstack sudo[76284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:43 devstack sudo[76284]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:43 devstack sudo[76323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:43 devstack sudo[76323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:43 devstack sudo[76323]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:43 devstack sudo[76377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:43 devstack sudo[76377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:43 devstack sudo[76377]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:43 devstack cinder-volume[75586]: INFO cinder.volume.drivers.lvm [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:43 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:43 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:43 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:44 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:44 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:44 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:44 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:44 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:44 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:44 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:44 devstack sudo[76396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:44 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:44 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:44 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:44 devstack sudo[76399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:44 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:45 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:45 devstack cinder-volume[75586]: INFO cinder.volume.driver [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG cinder.volume.driver [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75586) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_db.sqlalchemy.engines [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG dbcounter [-] [75586] Writer thread running {{(pid=75586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG cinder.db.api [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Building query based on filter {{(pid=75586) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4158}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG cinder.image.image_utils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75586) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:05:45 devstack cinder-volume[75586]: INFO cinder.keymgr.migration [None req-4e64fa08-162f-470c-955f-f24a79c43d97 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:45 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:45 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:45 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:45 devstack sudo[76408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:45 devstack sudo[76408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:45 devstack sudo[76408]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:45 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:45 devstack sudo[76411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:45 devstack sudo[76411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:46 devstack sudo[76411]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:46 devstack sudo[76414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:46 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:46 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG cinder.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Notifying Schedulers of capabilities ... {{(pid=75586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:05:46 devstack cinder-volume[75586]: INFO cinder.volume.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Driver initialization completed successfully. Sep 23 00:05:46 devstack cinder-volume[75586]: INFO cinder.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Initiating service 2 cleanup Sep 23 00:05:46 devstack cinder-volume[75586]: INFO cinder.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Service 2 cleanup completed. Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG cinder.service [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Creating RPC server for service cinder-volume {{(pid=75586) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG cinder.service [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75586) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:05:46 devstack cinder-volume[75586]: INFO cinder.volume.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:46 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:46 devstack sudo[76417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:46 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:47 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:47 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:47 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:47 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:47 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:47 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:47 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:47 devstack sudo[76431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:47 devstack sudo[76431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:47 devstack sudo[76431]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:47 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:47 devstack cinder-volume[75586]: INFO cinder.volume.manager [None req-101dae4b-5620-481e-8f6d-5d965988bc6b None None] Driver post RPC initialization completed successfully. Sep 23 00:05:49 devstack cinder-volume[75412]: DEBUG dbcounter [-] [75412] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:57 devstack cinder-volume[75586]: DEBUG dbcounter [-] [75586] Writing DB stats cinder:SELECT=4 {{(pid=75586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:57 devstack cinder-volume[75586]: DEBUG dbcounter [-] [75586] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:05 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager._thread_info {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:05 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread count: 6 {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:06:05 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread info: [<_MainThread(MainThread, started 124492720849024)>, , , , , ] {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:07:05 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:05 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:07:05 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:05 devstack sudo[79029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:07:05 devstack sudo[79029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:06 devstack sudo[79029]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:06 devstack sudo[79032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:06 devstack sudo[79032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:06 devstack sudo[79032]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:06 devstack sudo[79035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:07:06 devstack sudo[79035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:06 devstack sudo[79035]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:06 devstack sudo[79038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:06 devstack sudo[79038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:06 devstack sudo[79038]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:07 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:07 devstack cinder-volume[75586]: DEBUG cinder.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Notifying Schedulers of capabilities ... {{(pid=75586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:07:07 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager._thread_info {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:07 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread count: 6 {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:07:07 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread info: [<_MainThread(MainThread, started 124492720849024)>, , , , , ] {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:07:57 devstack cinder-volume[75586]: DEBUG dbcounter [-] [75586] Writing DB stats cinder:SELECT=1 {{(pid=75586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:07:57 devstack cinder-volume[75586]: DEBUG dbcounter [-] [75586] Writing DB stats cinder:UPDATE=1 {{(pid=75586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:05 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:05 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:08:05 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:05 devstack sudo[82022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:08:05 devstack sudo[82022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:06 devstack sudo[82022]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:06 devstack sudo[82029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:06 devstack sudo[82029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:06 devstack sudo[82029]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:06 devstack sudo[82033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:08:06 devstack sudo[82033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:06 devstack sudo[82033]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:06 devstack sudo[82043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:06 devstack sudo[82043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:07 devstack sudo[82043]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:07 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:07 devstack cinder-volume[75586]: DEBUG cinder.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Notifying Schedulers of capabilities ... {{(pid=75586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:07 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager._thread_info {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:07 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread count: 6 {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:08:07 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread info: [<_MainThread(MainThread, started 124492720849024)>, , , , , ] {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:09:05 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:05 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:09:05 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:05 devstack sudo[84011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:09:05 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:06 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:06 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:06 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:06 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:06 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:09:06 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:06 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:06 devstack sudo[84031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:06 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:07 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:07 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:07 devstack cinder-volume[75586]: DEBUG cinder.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Notifying Schedulers of capabilities ... {{(pid=75586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:57 devstack cinder-volume[75586]: DEBUG dbcounter [-] [75586] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:05 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:05 devstack cinder-volume[75586]: DEBUG cinder.volume.drivers.lvm [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Updating volume stats {{(pid=75586) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:10:05 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:05 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:10:06 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:06 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:06 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:10:06 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:06 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:06 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:10:06 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:06 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:06 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:06 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:10:06 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:07 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:07 devstack cinder-volume[75586]: DEBUG oslo_concurrency.processutils [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:07 devstack cinder-volume[75586]: DEBUG cinder.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Notifying Schedulers of capabilities ... {{(pid=75586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:07 devstack cinder-volume[75586]: DEBUG oslo_service.periodic_task [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] Running periodic task VolumeManager._thread_info {{(pid=75586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:07 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread count: 6 {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:10:07 devstack cinder-volume[75586]: DEBUG cinder.volume.manager [None req-06602c26-eea4-4b1b-b331-865eaa7c8c5f None None] thread info: [<_MainThread(MainThread, started 124492720849024)>, , , , , ] {{(pid=75586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:10:26 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Caught SIGTERM, stopping children Sep 23 00:10:26 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Acquiring lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:26 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Acquired lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:26 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Releasing lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:26 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Stop services. {{(pid=75412) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:10:26 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Killing children. {{(pid=75412) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:10:26 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Waiting on 1 children to exit Sep 23 00:10:26 devstack cinder-volume[75586]: DEBUG oslo_concurrency.lockutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Acquiring lock "singleton_lock" {{(pid=75586) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:26 devstack cinder-volume[75586]: DEBUG oslo_concurrency.lockutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Acquired lock "singleton_lock" {{(pid=75586) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:26 devstack cinder-volume[75586]: DEBUG oslo_concurrency.lockutils [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Releasing lock "singleton_lock" {{(pid=75586) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:26 devstack cinder-volume[75586]: WARNING amqp [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:10:26 devstack cinder-volume[75586]: WARNING amqp [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:10:26 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-9e26fbf1-6ca3-4953-9784-10893974f8c9 None None] Child 75586 exited with status 0 Sep 23 00:10:27 devstack cinder-volume[86237]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:10:27 devstack cinder-volume[86237]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:10:27 devstack cinder-volume[86237]: we strongly recommend against using it for new projects. Sep 23 00:10:27 devstack cinder-volume[86237]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:10:27 devstack cinder-volume[86237]: framework. For more detail see Sep 23 00:10:27 devstack cinder-volume[86237]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:10:27 devstack cinder-volume[86237]: import eventlet # noqa Sep 23 00:10:29 devstack cinder-volume[86237]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86237) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:29 devstack cinder-volume[86237]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86237) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:29 devstack cinder-volume[86237]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86237) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:30 devstack cinder-volume[86237]: INFO dbcounter [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Registered counter for database cinder Sep 23 00:10:30 devstack cinder-volume[86237]: DEBUG oslo_db.sqlalchemy.engines [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86237) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:30 devstack cinder-volume[86237]: DEBUG dbcounter [-] [86237] Writer thread running {{(pid=86237) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:30 devstack cinder-volume[86237]: INFO cinder.rpc [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:10:30 devstack cinder-volume[86237]: INFO cinder.rpc [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_db.sqlalchemy.engines [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86237) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:31 devstack cinder-volume[86237]: INFO cinder.volume.manager [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Determined volume DB was empty at startup. Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG cinder.volume.manager [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86237) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:10:31 devstack cinder-volume[86237]: INFO cinder.volume.manager [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:10:31 devstack cinder-volume[86237]: WARNING stevedore.named [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:10:31 devstack cinder-volume[86237]: WARNING castellan.key_manager [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:31 devstack cinder-volume[86237]: WARNING cinder.keymgr.conf_key_mgr [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:31 devstack cinder-volume[86237]: INFO cinder.volume.manager [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_db.sqlalchemy.engines [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86237) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:31 devstack cinder-volume[86237]: INFO oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Starting 1 workers Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Started child 86554 {{(pid=86237) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Full set of CONF: {{(pid=86237) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] ******************************************************************************** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Configuration options gathered from: {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:10:31 devstack cinder-volume[86554]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] ================================================================================ {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] allow_availability_zone_fallback = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] allow_compression_on_image_upload = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] allowed_direct_url_schemes = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] api_rate_limit = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] auth_strategy = keystone {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_availability_zone = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_host = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_stats_polling_interval = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backup_api_class = cinder.backup.api.API {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backup_name_template = backup-%s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backup_use_same_host = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backup_use_temp_snapshot = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] chap_password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] chap_username = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_internal_tenant_project_id = 1a0d900e2936429485f61f5623116547 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_internal_tenant_user_id = 9532d7cd5b5742b8b1ca71558bb109f5 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cluster = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] compression_format = gzip {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] compute_api_class = cinder.compute.nova.API {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] config_dir = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] config_source = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] control_exchange = openstack {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] debug = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] default_availability_zone = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] default_group_type = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] default_volume_type = QuobyteHD {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] deployment_max_gigabytes = -1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] disk_geometry = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] driver_client_cert = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] driver_client_cert_key = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] driver_data_namespace = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] driver_ssl_cert_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] driver_ssl_cert_verify = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] driver_use_ssl = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] enable_new_services = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] enable_unsupported_driver = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] enabled_backends = ['QuobyteHD'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] enforce_multipath_for_image_xfer = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] filter_function = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_api_insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_api_servers = ['http://192.168.122.145/image'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_api_ssl_compression = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_ca_certificates_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_catalog_info = image:glance:publicURL {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_num_retries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance_request_timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] goodness_function = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] graceful_shutdown_timeout = 5 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] group_api_class = cinder.group.api.API {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] host = devstack {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_compress_on_upload = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_conversion_address_space_limit = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_conversion_cpu_limit = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_conversion_disable = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_introspection_address_space_limit = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_introspection_cpu_limit = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_upload_use_cinder_backend = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_upload_use_internal_tenant = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_volume_cache_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_volume_cache_max_count = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] image_volume_cache_max_size_gb = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] init_host_max_objects_retrieval = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] instance_format = [instance: %(uuid)s] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86554]: INFO cinder.volume.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.remotefs [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86554) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] iscsi_target_flags = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] iscsi_write_cache = on {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] iser_helper = tgtadm {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] iser_ip_address = 192.168.122.145 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] iser_port = 3260 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_color = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_config_append = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_dir = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_options = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_rotate_interval = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_rotate_interval_type = days {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] log_rotation_type = none {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] max_age = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] max_logfile_count = 30 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] max_logfile_size_mb = 200 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] max_over_subscription_ratio = 20.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] message_reap_interval = 86400 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] message_ttl = 2592000 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] migration_create_volume_timeout_secs = 300 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] monkey_patch = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] monkey_patch_modules = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] my_ip = 192.168.122.145 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] no_snapshot_gb_quota = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] num_iser_scan_tries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] num_shell_tries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] num_volume_device_scan_tries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] nvmeof_conn_info_version = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] nvmet_ns_id = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] nvmet_port_id = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_max_limit = 1000 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_volume_ext_list = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_volume_listen_port = 8776 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_volume_use_ssl = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] osapi_volume_workers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] per_volume_size_limit = -1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] periodic_fuzzy_delay = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] periodic_interval = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] public_endpoint = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] publish_errors = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_backup_gigabytes = 1000 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_backups = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_gigabytes = 1000 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_groups = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_snapshots = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] quota_volumes = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] rate_limit_burst = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] rate_limit_except_level = CRITICAL {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] rate_limit_interval = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] reinit_driver_count = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] replication_device = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] report_discard_supported = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] report_interval = 120 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] reservation_clean_interval = 86400 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] reservation_expire = 86400 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] reserved_image_namespaces = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] reserved_percentage = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] rpc_response_timeout = 120 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] run_external_periodic_tasks = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] scst_target_driver = iscsi {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] scst_target_iqn_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_down_time = 720 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] shell_completion = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] snapshot_name_template = snapshot-%s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] split_loggers = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] state_path = /opt/stack/data/cinder {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] storage_availability_zone = nova {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] storage_protocol = iSCSI {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] syslog_log_facility = LOG_USER {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] target_helper = lioadm {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] target_ip_address = 192.168.122.145 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] target_port = 3260 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] target_protocol = iscsi {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] target_secondary_ip_addresses = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] trace_flags = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] transport_url = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] until_refresh = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_chap_auth = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_default_quota_class = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_journal = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_json = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_multipath_for_image_xfer = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_stderr = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] use_syslog = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] verify_glance_signatures = enabled {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_api_class = cinder.volume.api.API {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_backend_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_clear = zero {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_clear_ionice = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_clear_size = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_copy_bps_limit = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_dd_blocksize = 1M {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_name_template = volume-%s {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_service_inithost_offload = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volume_usage_audit_period = month {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] zoning_mode = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_concurrency.disable_process_locking = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.auth_section = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.auth_type = password {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.auth_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.cache = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86554) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:10:31 devstack cinder-volume[86554]: WARNING cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.include_service_catalog = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: WARNING cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.interface = public {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Running cmd (subprocess): mount.quobyte {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcache_username = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.region_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.service_type = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.145/identity {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.backend = dogpile.cache.null {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.backend_argument = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.backend_expiration_time = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.config_prefix = cache.oslo {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.debug_cache_backend = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.enable_retry_client = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.enable_socket_keepalive = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.expiration_time = 600 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.hashclient_retry_attempts = 2 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_dead_retry = 300 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_pool_maxsize = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_sasl_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.proxies = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.redis_db = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.redis_server = localhost:6379 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.retry_attempts = 2 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.retry_delay = 0.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.socket_keepalive_count = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.socket_keepalive_idle = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.socket_keepalive_interval = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.socket_timeout = 1.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.tls_allowed_ciphers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.tls_cafile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.tls_certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.tls_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.tls_keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cache.username = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] coordination.backend_url = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.asyncio_connection = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.asyncio_slave_connection = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.backend = sqlalchemy {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.connection = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.connection_debug = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.connection_parameters = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.connection_recycle_time = 3600 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.connection_trace = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.db_inc_retry_interval = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.db_max_retries = 20 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.db_max_retry_interval = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.db_retry_interval = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.max_overflow = 50 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.max_pool_size = 5 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.max_retries = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.mysql_wsrep_sync_wait = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.pool_timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.retry_interval = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.slave_connection = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.sqlite_synchronous = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.synchronous_reader = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] database.use_db_reconnect = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_tracing.insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.connection_string = messaging:// {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.es_doc_type = notification {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.es_scroll_size = 10000 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.es_scroll_time = 2m {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.filter_error_trace = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.hmac_keys = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.sentinel_service_name = mymaster {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.socket_timeout = 0.1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.trace_requests = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler.trace_sqlalchemy = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler_jaeger.process_tags = {} {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler_jaeger.service_name_prefix = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] profiler_otlp.service_name_prefix = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.enforce_new_defaults = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.policy_default_rule = default {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.policy_file = policy.yaml {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.group = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.helper_command = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] privsep_osbrick.user = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.group = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.helper_command = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] cinder_sys_admin.user = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.auth_section = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.auth_type = password {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.cafile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.collect_timing = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.send_service_user_token = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.split_loggers = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.tls_ciphers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] service_user.tls_min_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.auth_section = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.auth_type = password {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.collect_timing = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.region_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.split_loggers = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.tls_ciphers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] glance.tls_min_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.backend_availability_zone = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.chap_password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.chap_username = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.disk_geometry = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.driver_client_cert = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.driver_client_cert_key = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.driver_data_namespace = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.driver_use_ssl = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.extra_capabilities = {} {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.filter_function = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.goodness_function = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.iscsi_target_flags = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.iscsi_write_cache = on {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.iser_helper = tgtadm {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.iser_ip_address = 192.168.122.145 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.iser_port = 3260 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_host = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_login = admin {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_mount_options = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_private_key = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_share_path = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_ssh_port = 22 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.num_shell_tries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_client_cfg = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.quobyte_volume_url = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.replication_device = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.report_discard_supported = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.reserved_percentage = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.target_helper = tgtadm {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.target_ip_address = 192.168.122.145 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.target_port = 3260 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.target_protocol = iscsi {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.trace_flags = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.unique_fqdn_network = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.use_chap_auth = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack quobyte-client[86555]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:10:31 devstack quobyte-client[86555]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_backend_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_clear = zero {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_clear_ionice = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_clear_size = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_reports.file_event_handler = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_reports.log_dir = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.backend_availability_zone = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.backend_host = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.chap_password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.chap_username = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.chiscsi_conf = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.disk_geometry = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.driver_client_cert = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.driver_client_cert_key = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.driver_data_namespace = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.driver_use_ssl = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.extra_capabilities = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.filter_function = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.goodness_function = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=86554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: INFO cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 ... Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.iscsi_target_flags = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.iscsi_write_cache = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.iser_helper = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.iser_ip_address = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.iser_port = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.iser_target_prefix = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_host = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_login = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_mount_options = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_password = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_private_key = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_share_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_ssh_port = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.num_shell_tries = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nvmet_ns_id = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.nvmet_port_id = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc -c /etc/quobyte/client-cinder.cfg {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.replication_device = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.report_discard_supported = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.reserved_percentage = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.scst_target_driver = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.storage_protocol = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.target_helper = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.target_ip_address = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.target_port = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.target_prefix = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.target_protocol = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.trace_flags = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.unique_fqdn_network = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.use_chap_auth = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_clear = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_clear_ionice = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_clear_size = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] QuobyteHD.volumes_dir = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_notifications.driver = [] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_notifications.retry = -1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] key_manager.fixed_key = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.barbican_api_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.barbican_endpoint = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.barbican_endpoint_type = public {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.barbican_region_name = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.cafile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.collect_timing = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.number_of_retries = 60 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.retry_delay = 1 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc -c /etc/quobyte/client-cinder.cfg Sep 23 00:10:31 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.send_service_user_token = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.split_loggers = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.tls_ciphers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.tls_min_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.verify_ssl = True {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican.verify_ssl_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.auth_section = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.auth_type = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.cafile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.certfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.collect_timing = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.insecure = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.keyfile = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.split_loggers = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.timeout = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.tls_ciphers = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] barbican_service_user.tls_min_version = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.approle_role_id = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.approle_secret_id = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.auth_method = approle {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.auth_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.kv_mountpoint = secret {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.kv_path = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.kv_version = 2 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.namespace = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.root_token_id = **** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.ssl_ca_crt_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.timeout = 60.0 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.token_file = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.token_role = None {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.use_ssl = False {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:31 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] ******************************************************************************** {{(pid=86237) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:10:32 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.577s {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:32 devstack cinder-volume[86554]: INFO cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 succeeded Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=86554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.592s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:32 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:32 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:32 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.305s {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:32 devstack cinder-volume[86554]: INFO cinder.volume.driver [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG cinder.volume.driver [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86554) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_db.sqlalchemy.engines [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG dbcounter [-] [86554] Writer thread running {{(pid=86554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG cinder.db.api [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Building query based on filter {{(pid=86554) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4158}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG cinder.image.image_utils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86554) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:10:32 devstack cinder-volume[86554]: INFO cinder.keymgr.migration [None req-46ed2cd7-de5a-4cce-b6fb-be0199c581b2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=86554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=86554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:32 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:32 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:32 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:32 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.256s {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG cinder.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Notifying Schedulers of capabilities ... {{(pid=86554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:33 devstack cinder-volume[86554]: INFO cinder.volume.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Driver initialization completed successfully. Sep 23 00:10:33 devstack cinder-volume[86554]: INFO cinder.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Initiating service 3 cleanup Sep 23 00:10:33 devstack cinder-volume[86554]: INFO cinder.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Service 3 cleanup completed. Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG cinder.service [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Creating RPC server for service cinder-volume {{(pid=86554) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG cinder.service [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86554) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:10:33 devstack cinder-volume[86554]: INFO cinder.volume.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=86554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=86554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:33 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:33 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:33 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:33 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.291s {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:33 devstack cinder-volume[86554]: INFO cinder.volume.manager [None req-9da7fe16-7a50-42a4-a50e-f765deecf873 None None] Driver post RPC initialization completed successfully. Sep 23 00:10:38 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:38 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:38 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=86554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:38 devstack cinder-volume[86554]: DEBUG cinder.volume.drivers.quobyte [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=86554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:38 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86554) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:38 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:38 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:38 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:39 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:39 devstack cinder-volume[86554]: DEBUG oslo_concurrency.processutils [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.299s {{(pid=86554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:39 devstack cinder-volume[86554]: DEBUG cinder.manager [None req-418e945c-556e-40a7-8346-ffdd53fb0632 None None] Notifying Schedulers of capabilities ... {{(pid=86554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:41 devstack cinder-volume[86237]: DEBUG dbcounter [-] [86237] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86237) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:42 devstack cinder-volume[86237]: INFO oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Caught SIGTERM, stopping children Sep 23 00:10:42 devstack cinder-volume[86237]: DEBUG oslo_concurrency.lockutils [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Acquiring lock "singleton_lock" {{(pid=86237) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:42 devstack cinder-volume[86237]: DEBUG oslo_concurrency.lockutils [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Acquired lock "singleton_lock" {{(pid=86237) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:42 devstack cinder-volume[86237]: DEBUG oslo_concurrency.lockutils [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Releasing lock "singleton_lock" {{(pid=86237) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:42 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Stop services. {{(pid=86237) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:10:42 devstack cinder-volume[86237]: DEBUG oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Killing children. {{(pid=86237) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:10:42 devstack cinder-volume[86237]: INFO oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Waiting on 1 children to exit Sep 23 00:10:43 devstack cinder-volume[86554]: DEBUG dbcounter [-] [86554] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:43 devstack cinder-volume[86554]: DEBUG dbcounter [-] [86554] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:46 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Acquiring lock "singleton_lock" {{(pid=86554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:46 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Acquired lock "singleton_lock" {{(pid=86554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:46 devstack cinder-volume[86554]: DEBUG oslo_concurrency.lockutils [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Releasing lock "singleton_lock" {{(pid=86554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:46 devstack cinder-volume[86554]: WARNING amqp [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:10:46 devstack cinder-volume[86554]: WARNING amqp [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:10:46 devstack cinder-volume[86237]: INFO oslo_service.backend._eventlet.service [None req-c974131c-8476-484c-9e1b-700b42b016fd None None] Child 86554 exited with status 0 Sep 23 00:10:47 devstack cinder-volume[87009]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:10:47 devstack cinder-volume[87009]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:10:47 devstack cinder-volume[87009]: we strongly recommend against using it for new projects. Sep 23 00:10:47 devstack cinder-volume[87009]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:10:47 devstack cinder-volume[87009]: framework. For more detail see Sep 23 00:10:47 devstack cinder-volume[87009]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:10:47 devstack cinder-volume[87009]: import eventlet # noqa Sep 23 00:10:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:51 devstack cinder-volume[87009]: INFO dbcounter [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Registered counter for database cinder Sep 23 00:10:51 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writer thread running {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:52 devstack cinder-volume[87009]: INFO cinder.rpc [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:10:52 devstack cinder-volume[87009]: INFO cinder.rpc [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Determined volume DB was empty at startup. Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87009) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:10:52 devstack cinder-volume[87009]: WARNING stevedore.named [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:10:52 devstack cinder-volume[87009]: WARNING castellan.key_manager [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:52 devstack cinder-volume[87009]: WARNING cinder.keymgr.conf_key_mgr [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:52 devstack cinder-volume[87009]: INFO oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Starting 1 workers Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Started child 87292 {{(pid=87009) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Full set of CONF: {{(pid=87009) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] ******************************************************************************** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] Configuration options gathered from: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] ================================================================================ {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] allow_availability_zone_fallback = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] allow_compression_on_image_upload = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] allowed_direct_url_schemes = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] api_rate_limit = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] auth_strategy = keystone {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_host = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_stats_polling_interval = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backup_api_class = cinder.backup.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backup_name_template = backup-%s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backup_use_same_host = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backup_use_temp_snapshot = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] chap_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] chap_username = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87292]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_internal_tenant_project_id = 1a0d900e2936429485f61f5623116547 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_internal_tenant_user_id = 9532d7cd5b5742b8b1ca71558bb109f5 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cluster = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] compression_format = gzip {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] compute_api_class = cinder.compute.nova.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] config_dir = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] config_source = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] control_exchange = openstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] debug = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] default_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] default_group_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] default_volume_type = QuobyteHD {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] deployment_max_gigabytes = -1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] disk_geometry = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] driver_client_cert = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] driver_client_cert_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] driver_data_namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] driver_ssl_cert_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] driver_ssl_cert_verify = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] driver_use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] enable_new_services = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] enable_unsupported_driver = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] enabled_backends = ['QuobyteHD'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] enforce_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] filter_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_api_insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_api_servers = ['http://192.168.122.145/image'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_api_ssl_compression = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_ca_certificates_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_catalog_info = image:glance:publicURL {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_num_retries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance_request_timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] goodness_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] graceful_shutdown_timeout = 5 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] group_api_class = cinder.group.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] host = devstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_compress_on_upload = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_conversion_address_space_limit = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_conversion_cpu_limit = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_conversion_disable = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_introspection_address_space_limit = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_introspection_cpu_limit = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_upload_use_cinder_backend = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_upload_use_internal_tenant = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_volume_cache_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_volume_cache_max_count = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] image_volume_cache_max_size_gb = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] init_host_max_objects_retrieval = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] instance_format = [instance: %(uuid)s] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] iscsi_target_flags = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] iscsi_write_cache = on {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] iser_helper = tgtadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] iser_ip_address = 192.168.122.145 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] iser_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_color = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_config_append = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_dir = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_options = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_rotate_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_rotate_interval_type = days {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] log_rotation_type = none {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] max_age = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] max_logfile_count = 30 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] max_logfile_size_mb = 200 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] max_over_subscription_ratio = 20.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] message_reap_interval = 86400 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] message_ttl = 2592000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] migration_create_volume_timeout_secs = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] monkey_patch = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] monkey_patch_modules = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] my_ip = 192.168.122.145 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] no_snapshot_gb_quota = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] num_iser_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] num_shell_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] num_volume_device_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] nvmeof_conn_info_version = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] nvmet_ns_id = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] nvmet_port_id = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_max_limit = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_volume_ext_list = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_volume_listen_port = 8776 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_volume_use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] osapi_volume_workers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] per_volume_size_limit = -1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] periodic_fuzzy_delay = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] periodic_interval = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] public_endpoint = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] publish_errors = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_backup_gigabytes = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_backups = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_gigabytes = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_groups = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_snapshots = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] quota_volumes = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] rate_limit_burst = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] rate_limit_except_level = CRITICAL {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] rate_limit_interval = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] reinit_driver_count = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] replication_device = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] report_discard_supported = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] report_interval = 120 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] reservation_clean_interval = 86400 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] reservation_expire = 86400 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] reserved_image_namespaces = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] reserved_percentage = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] rpc_response_timeout = 120 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] run_external_periodic_tasks = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] scst_target_driver = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] scst_target_iqn_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_down_time = 720 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] shell_completion = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] snapshot_name_template = snapshot-%s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] state_path = /opt/stack/data/cinder {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] storage_availability_zone = nova {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] storage_protocol = iSCSI {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] syslog_log_facility = LOG_USER {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] target_helper = lioadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] target_ip_address = 192.168.122.145 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] target_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] target_protocol = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] target_secondary_ip_addresses = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] trace_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] transport_url = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] until_refresh = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_chap_auth = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87292) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_default_quota_class = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_journal = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_json = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_stderr = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] use_syslog = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] verify_glance_signatures = enabled {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_api_class = cinder.volume.api.API {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_backend_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_clear = zero {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_clear_ionice = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_clear_size = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_copy_bps_limit = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_dd_blocksize = 1M {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_name_template = volume-%s {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_service_inithost_offload = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volume_usage_audit_period = month {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] zoning_mode = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_concurrency.disable_process_locking = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.auth_type = password {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.auth_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.cache = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.include_service_catalog = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.interface = public {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcache_username = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.region_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.service_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.145/identity {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.backend = dogpile.cache.null {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.backend_argument = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.backend_expiration_time = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.config_prefix = cache.oslo {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.debug_cache_backend = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.enable_retry_client = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.enable_socket_keepalive = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.expiration_time = 600 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.hashclient_retry_attempts = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_dead_retry = 300 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_pool_maxsize = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_sasl_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.proxies = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.redis_db = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.redis_server = localhost:6379 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.retry_attempts = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.retry_delay = 0.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.socket_keepalive_count = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.socket_keepalive_idle = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.socket_keepalive_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.socket_timeout = 1.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.tls_allowed_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.tls_cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.tls_certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.tls_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.tls_keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cache.username = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] coordination.backend_url = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.asyncio_connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.asyncio_slave_connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.backend = sqlalchemy {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.connection_debug = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.connection_parameters = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.connection_recycle_time = 3600 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.connection_trace = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.db_inc_retry_interval = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.db_max_retries = 20 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.db_max_retry_interval = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.db_retry_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.max_overflow = 50 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.max_pool_size = 5 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.max_retries = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.mysql_wsrep_sync_wait = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.pool_timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.retry_interval = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.slave_connection = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.sqlite_synchronous = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.synchronous_reader = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] database.use_db_reconnect = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_tracing.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.connection_string = messaging:// {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.es_doc_type = notification {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.es_scroll_size = 10000 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.es_scroll_time = 2m {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.filter_error_trace = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.hmac_keys = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.sentinel_service_name = mymaster {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.socket_timeout = 0.1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.trace_requests = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler.trace_sqlalchemy = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler_jaeger.process_tags = {} {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler_jaeger.service_name_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] profiler_otlp.service_name_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.enforce_new_defaults = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.policy_default_rule = default {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.policy_file = policy.yaml {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.group = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.helper_command = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] privsep_osbrick.user = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.group = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.helper_command = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] cinder_sys_admin.user = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.auth_type = password {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.send_service_user_token = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.tls_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] service_user.tls_min_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.auth_type = password {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.region_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.tls_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] glance.tls_min_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.backend_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.chap_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.chap_username = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.disk_geometry = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.driver_client_cert = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.driver_client_cert_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.driver_data_namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.driver_use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.extra_capabilities = {} {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.filter_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.goodness_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87292) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.iscsi_target_flags = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.iscsi_write_cache = on {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.iser_helper = tgtadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.iser_ip_address = 192.168.122.145 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.iser_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_host = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_login = admin {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_mount_options = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Running cmd (subprocess): mount.quobyte {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_private_key = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_share_path = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.num_shell_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.quobyte_volume_url = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.replication_device = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.report_discard_supported = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.reserved_percentage = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.target_helper = tgtadm {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.target_ip_address = 192.168.122.145 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.target_port = 3260 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.target_protocol = iscsi {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.trace_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.unique_fqdn_network = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.use_chap_auth = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_backend_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_clear = zero {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_clear_ionice = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_clear_size = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_reports.file_event_handler = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_reports.log_dir = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.backend_availability_zone = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.backend_host = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.chap_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.chap_username = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.chiscsi_conf = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.disk_geometry = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.driver_client_cert = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.driver_data_namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.driver_use_ssl = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.extra_capabilities = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.filter_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.goodness_function = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.iser_helper = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.iser_ip_address = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.iser_port = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.iser_target_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_host = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_login = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_mount_options = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_password = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_private_key = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_share_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_ssh_port = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.num_shell_tries = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.nvmet_port_id = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.replication_device = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.report_discard_supported = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.reserved_percentage = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.scst_target_driver = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.storage_protocol = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.target_helper = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.target_ip_address = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.target_port = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.target_prefix = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.target_protocol = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.trace_flags = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.use_chap_auth = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_clear = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_clear_size = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] QuobyteHD.volumes_dir = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_notifications.driver = [] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_notifications.retry = -1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] key_manager.fixed_key = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack quobyte-client[87293]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:10:52 devstack quobyte-client[87293]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.barbican_api_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.barbican_endpoint = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.barbican_endpoint_type = public {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.barbican_region_name = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.number_of_retries = 60 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.retry_delay = 1 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.send_service_user_token = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.tls_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.tls_min_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.verify_ssl = True {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican.verify_ssl_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.auth_section = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.auth_type = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.cafile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.certfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.collect_timing = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.insecure = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.keyfile = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.split_loggers = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.timeout = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.tls_ciphers = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] barbican_service_user.tls_min_version = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.approle_role_id = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.approle_secret_id = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.auth_method = approle {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.auth_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.kv_mountpoint = secret {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.kv_path = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.kv_version = 2 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.namespace = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.root_token_id = **** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.ssl_ca_crt_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.timeout = 60.0 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.token_file = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.token_role = None {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.use_ssl = False {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:52 devstack cinder-volume[87009]: DEBUG oslo_service.backend._eventlet.service [None req-baca7957-47f1-425a-8bd5-08c779cb9df5 None None] ******************************************************************************** {{(pid=87009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:52 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:52 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:52 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.297s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:52 devstack cinder-volume[87292]: INFO cinder.volume.driver [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG cinder.volume.driver [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87292) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writer thread running {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:52 devstack cinder-volume[87292]: DEBUG cinder.db.api [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Building query based on filter {{(pid=87292) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4158}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87292) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:53 devstack cinder-volume[87292]: INFO cinder.keymgr.migration [None req-3beaa9c0-bde9-4e2f-8a71-e61dc342e5ff None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:10:53 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:53 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:53 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.290s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Driver initialization completed successfully. Sep 23 00:10:53 devstack cinder-volume[87292]: INFO cinder.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Initiating service 3 cleanup Sep 23 00:10:53 devstack cinder-volume[87292]: INFO cinder.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Service 3 cleanup completed. Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.service [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Creating RPC server for service cinder-volume {{(pid=87292) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.service [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87292) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:10:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:53 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:10:53 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:53 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a9e2bd54-75c5-44ad-b71c-1ecebf4b8e15 None None] Driver post RPC initialization completed successfully. Sep 23 00:10:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 6 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:10:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:11:02 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:54 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:11:54 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:55 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Flow 'volume_create_manager' (2eef416a-301d-4608-8a58-1fca2a6e383c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c4998f-9ddf-40b0-8f8a-e933ec259dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.806s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 6 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c4998f-9ddf-40b0-8f8a-e933ec259dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1050561559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b284135a52624e3fbd650e05b4021667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:55Z,use_quota=True,user_id='7d0a41769e6c4ab29f32efece84c1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbd2a7c-f996-4e5a-97bb-59d982df59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbd2a7c-f996-4e5a-97bb-59d982df59ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd31f650-badc-43f3-a503-1fe17d9651cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd31f650-badc-43f3-a503-1fe17d9651cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a', 'volume_name': 'volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb07c50-e8d7-4332-9ad8-b827692e929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb07c50-e8d7-4332-9ad8-b827692e929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7821a0-4630-4a4c-a820-6368230e2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Volume aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a', 'volume_size': 1} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1050561559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b284135a52624e3fbd650e05b4021667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:55Z,use_quota=True,user_id='7d0a41769e6c4ab29f32efece84c1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Creating volume aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:55 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:11:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:55 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a 1073741824 Sep 23 00:11:55 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:56 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a 1073741824" returned: 0 in 0.897s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:56 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a Sep 23 00:11:56 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:56 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a" returned: 0 in 0.305s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7821a0-4630-4a4c-a820-6368230e2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9459c897-57a4-4e71-a512-9c091f02c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:57 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Volume volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a (aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a): created successfully Sep 23 00:11:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9459c897-57a4-4e71-a512-9c091f02c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Flow 'volume_create_manager' (2eef416a-301d-4608-8a58-1fca2a6e383c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:57 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-480ae9a3-dbc4-4c7c-87de-ea64ebcdcc14 tempest-TaggedAttachmentsTest-147829114 None] Created volume successfully. Sep 23 00:12:07 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:07 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Flow 'volume_create_manager' (075bbc45-241a-432a-8a9c-b46fba016a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d814a275-2fec-4823-9501-1a72a49ed120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d814a275-2fec-4823-9501-1a72a49ed120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1099251340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdd6157-e13c-4bb5-82ac-926669578887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa900d4aa4d490eafd5af39dae1db0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:30Z,use_quota=True,user_id='42bbca48489e4acdb9221a13158d9b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbb9bfb-8bdb-438f-b49a-baf04dc225c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbb9bfb-8bdb-438f-b49a-baf04dc225c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc788cc-53d8-4950-a2f1-1e7e75db6d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc788cc-53d8-4950-a2f1-1e7e75db6d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdd6157-e13c-4bb5-82ac-926669578887', 'volume_name': 'volume-0cdd6157-e13c-4bb5-82ac-926669578887', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940b8224-4108-4285-91e1-d7d90aae82f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940b8224-4108-4285-91e1-d7d90aae82f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e258abce-497b-45be-a8b4-949c353dc970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:29 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Volume 0cdd6157-e13c-4bb5-82ac-926669578887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdd6157-e13c-4bb5-82ac-926669578887', 'volume_size': 1} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1099251340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdd6157-e13c-4bb5-82ac-926669578887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa900d4aa4d490eafd5af39dae1db0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:30Z,use_quota=True,user_id='42bbca48489e4acdb9221a13158d9b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Creating volume 0cdd6157-e13c-4bb5-82ac-926669578887 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:29 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:12:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:29 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 1073741824 Sep 23 00:12:29 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:30 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 1073741824" returned: 0 in 0.708s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:30 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 Sep 23 00:12:30 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:30 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887" returned: 0 in 0.414s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e258abce-497b-45be-a8b4-949c353dc970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdd6157-e13c-4bb5-82ac-926669578887', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2f71f7-a4f5-4b82-a24e-fcef3209b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:30 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Volume volume-0cdd6157-e13c-4bb5-82ac-926669578887 (0cdd6157-e13c-4bb5-82ac-926669578887): created successfully Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2f71f7-a4f5-4b82-a24e-fcef3209b759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Flow 'volume_create_manager' (075bbc45-241a-432a-8a9c-b46fba016a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-97287dfe-f926-4304-912f-1f440ff94c3f tempest-DeleteServersTestJSON-1650863772 None] Created volume successfully. Sep 23 00:12:39 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Flow 'volume_create_manager' (702cd51b-45e7-4210-b3b0-6a94a2e68f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6edfe5d-e545-4da2-8dfa-25ca66363cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6edfe5d-e545-4da2-8dfa-25ca66363cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-504042953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c8a025-6788-4e01-86db-0e7825380e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7862f7d9719542b19420c84ce3a1d288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:40Z,use_quota=True,user_id='912bd71a14ce4f20a16827fb656e0654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35eca87-a4eb-43ca-b178-5bf3cecac02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35eca87-a4eb-43ca-b178-5bf3cecac02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdf0dd3-8759-434b-950c-6a7d07f133e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdf0dd3-8759-434b-950c-6a7d07f133e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c8a025-6788-4e01-86db-0e7825380e01', 'volume_name': 'volume-60c8a025-6788-4e01-86db-0e7825380e01', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95bfde5-e18b-4910-807a-8246bcd7860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95bfde5-e18b-4910-807a-8246bcd7860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01022d22-ee81-4233-bb6c-02cc9ef16a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Volume 60c8a025-6788-4e01-86db-0e7825380e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c8a025-6788-4e01-86db-0e7825380e01', 'volume_size': 1} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-504042953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c8a025-6788-4e01-86db-0e7825380e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7862f7d9719542b19420c84ce3a1d288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:40Z,use_quota=True,user_id='912bd71a14ce4f20a16827fb656e0654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Creating volume 60c8a025-6788-4e01-86db-0e7825380e01 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:40 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:12:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:40 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 1073741824 Sep 23 00:12:40 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:41 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 1073741824" returned: 0 in 1.194s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:41 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 Sep 23 00:12:41 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:42 devstack cinder-volume[87292]: WARNING py.warnings [req-5f20fe17-2961-4207-9cd3-411d7c9a97d1 req-788c7f96-dd1d-4101-a0fc-832aa993141f tempest-DeleteServersTestJSON-1650863772 None] /opt/stack/cinder/cinder/db/api.py:2684: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 23 00:12:42 devstack cinder-volume[87292]: .first() Sep 23 00:12:42 devstack cinder-volume[87292]: Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5f20fe17-2961-4207-9cd3-411d7c9a97d1 req-788c7f96-dd1d-4101-a0fc-832aa993141f tempest-DeleteServersTestJSON-1650863772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:42 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01" returned: 0 in 0.791s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5f20fe17-2961-4207-9cd3-411d7c9a97d1 req-788c7f96-dd1d-4101-a0fc-832aa993141f tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.073s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01022d22-ee81-4233-bb6c-02cc9ef16a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c8a025-6788-4e01-86db-0e7825380e01', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb548a36-8e57-478c-9c94-1c9ae7ec6f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Volume volume-60c8a025-6788-4e01-86db-0e7825380e01 (60c8a025-6788-4e01-86db-0e7825380e01): created successfully Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb548a36-8e57-478c-9c94-1c9ae7ec6f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Flow 'volume_create_manager' (702cd51b-45e7-4210-b3b0-6a94a2e68f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5f20fe17-2961-4207-9cd3-411d7c9a97d1 req-788c7f96-dd1d-4101-a0fc-832aa993141f tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.415s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-52566f84-ff44-48bb-9b14-6d55f9962968 tempest-VolumesAdminNegativeTest-627210434 None] Created volume successfully. Sep 23 00:12:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5f20fe17-2961-4207-9cd3-411d7c9a97d1 req-788c7f96-dd1d-4101-a0fc-832aa993141f tempest-DeleteServersTestJSON-1650863772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-0cdd6157-e13c-4bb5-82ac-926669578887', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d629505-3904-4da7-a020-216934489a41', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:12:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-5f20fe17-2961-4207-9cd3-411d7c9a97d1 req-788c7f96-dd1d-4101-a0fc-832aa993141f tempest-DeleteServersTestJSON-1650863772 None] attachment_update completed successfully. Sep 23 00:12:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Acquiring lock "cinder-60c8a025-6788-4e01-86db-0e7825380e01-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Lock "cinder-60c8a025-6788-4e01-86db-0e7825380e01-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Acquiring lock "cinder-quobyte-60c8a025-6788-4e01-86db-0e7825380e01" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Lock "cinder-quobyte-60c8a025-6788-4e01-86db-0e7825380e01" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:44 devstack cinder-volume[87292]: INFO oslo.privsep.daemon [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9wg6eyuc/privsep.sock'] Sep 23 00:12:44 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9wg6eyuc/privsep.sock Sep 23 00:12:44 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:12:47 devstack cinder-volume[87292]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 00:12:48 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:48 devstack cinder-volume[87292]: INFO oslo.privsep.daemon [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Spawned new privsep daemon via rootwrap Sep 23 00:12:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Accepted privsep connection to /tmp/tmp9wg6eyuc/privsep.sock {{(pid=87292) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 00:12:48 devstack cinder-volume[87292]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 00:12:48 devstack cinder-volume[87292]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 00:12:48 devstack cinder-volume[87292]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 00:12:48 devstack cinder-volume[87292]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88727 Sep 23 00:12:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d4cd8-5445-4e7b-8ba1-4432e51baa40]: (2,) {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f1cfd-a28a-43ba-b623-fe64dd90dfc7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:48 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 Sep 23 00:12:48 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:49 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01" returned: 0 in 1.125s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:49 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01 Sep 23 00:12:49 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:50 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-60c8a025-6788-4e01-86db-0e7825380e01" returned: 0 in 1.484s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Lock "cinder-quobyte-60c8a025-6788-4e01-86db-0e7825380e01" released by "delete_volume" :: held 6.485s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:51 devstack cinder-volume[87292]: WARNING cinder.quota [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:51 devstack cinder-volume[87292]: WARNING cinder.quota [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Created reservations ['d386f811-7b32-4e42-a4ea-554e088cd2c5', 'fc3448dc-07d5-417d-aa7c-818c9c8eec85', '8b964193-90fe-44eb-b742-1b4de37c145e', '2a3c15bd-a4c6-4bfd-8001-dd714815778c', 'b45b159c-786b-4f23-8aa2-761b7b0ea32a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:51 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:12:51 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:51 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:52 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Deleted volume successfully. Sep 23 00:12:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b7a46fcf-b3bd-4507-94ff-453b2e27fc5c tempest-VolumesAdminNegativeTest-627210434 None] Lock "cinder-60c8a025-6788-4e01-86db-0e7825380e01-delete_volume" released by "delete_volume" :: held 7.953s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-4fe6e3cd-b657-409b-b223-b7b744c6d30b req-e6078a00-43ef-4114-b87f-1408224a296f tempest-DeleteServersTestJSON-1650863772 None] Terminate volume connection completed successfully. Sep 23 00:12:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-4fe6e3cd-b657-409b-b223-b7b744c6d30b req-e6078a00-43ef-4114-b87f-1408224a296f tempest-DeleteServersTestJSON-1650863772 None] Deleting attachment 3d629505-3904-4da7-a020-216934489a41. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:54 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:12:54 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:55 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.605s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Acquiring lock "cinder-0cdd6157-e13c-4bb5-82ac-926669578887-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Lock "cinder-0cdd6157-e13c-4bb5-82ac-926669578887-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Acquiring lock "cinder-quobyte-0cdd6157-e13c-4bb5-82ac-926669578887" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Lock "cinder-quobyte-0cdd6157-e13c-4bb5-82ac-926669578887" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506cf9f-3a14-480b-9fab-2a5b39ed8e12]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:56 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 Sep 23 00:12:56 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:56 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887" returned: 0 in 0.515s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:56 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887 Sep 23 00:12:56 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:57 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0cdd6157-e13c-4bb5-82ac-926669578887" returned: 0 in 0.384s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Lock "cinder-quobyte-0cdd6157-e13c-4bb5-82ac-926669578887" released by "delete_volume" :: held 1.001s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Created reservations ['0cde39fe-5dc3-4742-af92-7f8880875d73', '739b61d4-712f-4bc0-b87e-2d0c2938011f', 'd72618a3-6b24-43b8-b523-f9297482365d', '601d9be3-28be-41f7-bbd7-06c6f57fb24d', '4653355c-4610-4df3-98c6-dd9e082ad2e8'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:57 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:12:57 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:58 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.488s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:58 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Deleted volume successfully. Sep 23 00:12:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-35142ce4-d698-45ae-9353-bcdceadc29d0 tempest-DeleteServersTestJSON-1650863772 None] Lock "cinder-0cdd6157-e13c-4bb5-82ac-926669578887-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:07 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:08 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-be50e694-0d15-417c-9d3d-81015efb043a req-5c2630f4-10da-46d5-a777-d392eb2424dd tempest-TaggedAttachmentsTest-147829114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-be50e694-0d15-417c-9d3d-81015efb043a req-5c2630f4-10da-46d5-a777-d392eb2424dd tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-be50e694-0d15-417c-9d3d-81015efb043a req-5c2630f4-10da-46d5-a777-d392eb2424dd tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-be50e694-0d15-417c-9d3d-81015efb043a req-5c2630f4-10da-46d5-a777-d392eb2424dd tempest-TaggedAttachmentsTest-147829114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4646246d-ccf0-4db2-ab9c-7a843e063b93', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:13:32 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-be50e694-0d15-417c-9d3d-81015efb043a req-5c2630f4-10da-46d5-a777-d392eb2424dd tempest-TaggedAttachmentsTest-147829114 None] attachment_update completed successfully. Sep 23 00:13:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-e5621933-f561-4657-83bd-c93a9d374a40 req-9e5fb84b-b27c-4273-8804-880b640ac3d4 tempest-TaggedAttachmentsTest-147829114 None] Terminate volume connection completed successfully. Sep 23 00:13:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-e5621933-f561-4657-83bd-c93a9d374a40 req-9e5fb84b-b27c-4273-8804-880b640ac3d4 tempest-TaggedAttachmentsTest-147829114 None] Deleting attachment 4646246d-ccf0-4db2-ab9c-7a843e063b93. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:13:48 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:48 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:54 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:13:54 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:55 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.933s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 8 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:13:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Acquiring lock "cinder-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Lock "cinder-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Acquiring lock "cinder-quobyte-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Lock "cinder-quobyte-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a" acquired by "delete_volume" :: waited 0.061s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ea56c3-42bf-4eab-b5cf-bcea9eab4b6f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:09 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a Sep 23 00:14:09 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:10 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a" returned: 0 in 1.070s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:10 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a Sep 23 00:14:10 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:10 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Flow 'volume_create_manager' (1c8544f6-e346-4ca1-a324-0bd3b3fccf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a93b6c-4c96-4d72-b931-88e1530f7b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a93b6c-4c96-4d72-b931-88e1530f7b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-466464544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f91b4c2-5188-42d4-8fed-04f64e7b09cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c6a9f7c8924ccd8f197c9ead4088b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:11Z,use_quota=True,user_id='db5aad247ee24c47a0de915c6c0a7a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0eb3638-86fe-4ae1-ad2f-aaf11485ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0eb3638-86fe-4ae1-ad2f-aaf11485ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04464411-febf-41fe-8181-9c266406d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04464411-febf-41fe-8181-9c266406d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f91b4c2-5188-42d4-8fed-04f64e7b09cd', 'volume_name': 'volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48b99ac-54c0-47c2-a325-bb45f6376bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:11 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48b99ac-54c0-47c2-a325-bb45f6376bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e5c801-9f8d-401f-b80f-86af92dcbebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:11 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Volume 0f91b4c2-5188-42d4-8fed-04f64e7b09cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd', 'volume_size': 1} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-466464544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f91b4c2-5188-42d4-8fed-04f64e7b09cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c6a9f7c8924ccd8f197c9ead4088b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:11Z,use_quota=True,user_id='db5aad247ee24c47a0de915c6c0a7a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Creating volume 0f91b4c2-5188-42d4-8fed-04f64e7b09cd {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:11 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a" returned: 0 in 0.640s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Lock "cinder-quobyte-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a" released by "delete_volume" :: held 1.874s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:11 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd 1073741824 Sep 23 00:14:11 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Created reservations ['51889277-e3de-4842-8c88-ae1efcad3426', '33813148-e382-4c78-b651-c43a5054da8a', 'd067690b-9694-425d-a482-e8cf5ea1cf31', 'a72f758e-ad3b-459a-812d-4f7ccae8b016', 'f956f6a1-02f3-4fee-88cc-51c5c214ffdf'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:12 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:14:12 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:12 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd 1073741824" returned: 0 in 1.434s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:12 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd Sep 23 00:14:12 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:13 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 1.239s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Deleted volume successfully. Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7df36977-f930-43f1-9902-e0375cd81937 tempest-TaggedAttachmentsTest-147829114 None] Lock "cinder-aff2caa1-cfa0-4ea5-8eaf-e4aafaad009a-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:13 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd" returned: 0 in 0.840s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e5c801-9f8d-401f-b80f-86af92dcbebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cea42d-0648-455d-9497-e2207f1617c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Volume volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd (0f91b4c2-5188-42d4-8fed-04f64e7b09cd): created successfully Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cea42d-0648-455d-9497-e2207f1617c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Flow 'volume_create_manager' (1c8544f6-e346-4ca1-a324-0bd3b3fccf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3c2127c0-c2a4-4c9e-b949-d55f13159bbd tempest-ServerRescueNegativeTestJSON-1970796360 None] Created volume successfully. Sep 23 00:14:23 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:23 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:37 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Flow 'volume_create_manager' (4b72799b-e93f-4434-a0a1-bce1f26fa667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c18452-b8fd-4d34-affb-08c0d72d7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c18452-b8fd-4d34-affb-08c0d72d7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846214895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8ba2b8-ffd0-4731-94cf-42c01690ecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f329ac0188f34bf3a57aac22fe8032d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:38Z,use_quota=True,user_id='1a767ebfecc0435a9c7cbf7e0a1f7346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373e0e76-d27b-425a-b336-98aba6e228a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373e0e76-d27b-425a-b336-98aba6e228a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacd1b91-577f-46bd-be48-05c876e8b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacd1b91-577f-46bd-be48-05c876e8b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8ba2b8-ffd0-4731-94cf-42c01690ecbe', 'volume_name': 'volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71665688-7d6b-4069-a61e-5d2bc12e77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71665688-7d6b-4069-a61e-5d2bc12e77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c954af-e6b2-4e3f-8209-f5d1b52b62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Volume ba8ba2b8-ffd0-4731-94cf-42c01690ecbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe', 'volume_size': 1} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846214895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8ba2b8-ffd0-4731-94cf-42c01690ecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f329ac0188f34bf3a57aac22fe8032d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:38Z,use_quota=True,user_id='1a767ebfecc0435a9c7cbf7e0a1f7346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Creating volume ba8ba2b8-ffd0-4731-94cf-42c01690ecbe {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:38 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:38 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe 1073741824 Sep 23 00:14:38 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Acquiring lock "cinder-0f91b4c2-5188-42d4-8fed-04f64e7b09cd-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "cinder-0f91b4c2-5188-42d4-8fed-04f64e7b09cd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Acquiring lock "cinder-quobyte-0f91b4c2-5188-42d4-8fed-04f64e7b09cd" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "cinder-quobyte-0f91b4c2-5188-42d4-8fed-04f64e7b09cd" acquired by "delete_volume" :: waited 0.052s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e0ebe-61b2-4e05-9834-bf5b276dd064]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:39 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd Sep 23 00:14:39 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:39 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe 1073741824" returned: 0 in 1.079s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:39 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe Sep 23 00:14:39 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:39 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd" returned: 0 in 0.649s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:39 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd Sep 23 00:14:39 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:40 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe" returned: 0 in 0.601s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c954af-e6b2-4e3f-8209-f5d1b52b62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fb4832-e6f8-4402-98f7-c64e032aa42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Volume volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe (ba8ba2b8-ffd0-4731-94cf-42c01690ecbe): created successfully Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fb4832-e6f8-4402-98f7-c64e032aa42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Flow 'volume_create_manager' (4b72799b-e93f-4434-a0a1-bce1f26fa667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-896eecd8-9cba-4b14-860f-99192b6f4b28 tempest-ServersNegativeTestJSON-360587185 None] Created volume successfully. Sep 23 00:14:40 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f91b4c2-5188-42d4-8fed-04f64e7b09cd" returned: 0 in 0.596s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "cinder-quobyte-0f91b4c2-5188-42d4-8fed-04f64e7b09cd" released by "delete_volume" :: held 1.319s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Created reservations ['b0184ec1-7307-46a9-a333-0a479c827402', '7edfb310-de72-4086-9395-76a4e0640c59', '763b5534-ee2a-4281-89c6-e05fa62280ac', '92c09cc4-f40d-4db7-a4d6-80718629cf0c', '0440a2f7-a644-4eb1-a09e-fb23ccbb067c'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:40 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:14:40 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:40 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Deleted volume successfully. Sep 23 00:14:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d00cc945-049e-4a6b-8d90-d83a9ec96e24 tempest-ServerRescueNegativeTestJSON-1970796360 None] Lock "cinder-0f91b4c2-5188-42d4-8fed-04f64e7b09cd-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Flow 'volume_create_manager' (9f13fba4-9334-42dc-a37f-3ab41be19b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a673bb4b-dfd2-4de8-bdbf-7b7446786747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a673bb4b-dfd2-4de8-bdbf-7b7446786747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1202141536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fece24f-e592-42fd-abc8-1456aab0fc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f329ac0188f34bf3a57aac22fe8032d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:45Z,use_quota=True,user_id='1a767ebfecc0435a9c7cbf7e0a1f7346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1bcc9c-09aa-4c87-94b2-8035de64ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1bcc9c-09aa-4c87-94b2-8035de64ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2adde17-f24f-4251-9f8d-a0541983c641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2adde17-f24f-4251-9f8d-a0541983c641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fece24f-e592-42fd-abc8-1456aab0fc86', 'volume_name': 'volume-7fece24f-e592-42fd-abc8-1456aab0fc86', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61967ba-93e7-46ac-913d-9ba5956ec359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61967ba-93e7-46ac-913d-9ba5956ec359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a633ecf5-be75-4bb1-a3e2-910929ec7a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Volume 7fece24f-e592-42fd-abc8-1456aab0fc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fece24f-e592-42fd-abc8-1456aab0fc86', 'volume_size': 1} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1202141536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fece24f-e592-42fd-abc8-1456aab0fc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f329ac0188f34bf3a57aac22fe8032d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:45Z,use_quota=True,user_id='1a767ebfecc0435a9c7cbf7e0a1f7346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Creating volume 7fece24f-e592-42fd-abc8-1456aab0fc86 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:45 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:14:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:45 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 1073741824 Sep 23 00:14:45 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:46 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 1073741824" returned: 0 in 0.964s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:46 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 Sep 23 00:14:46 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:46 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86" returned: 0 in 0.332s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a633ecf5-be75-4bb1-a3e2-910929ec7a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fece24f-e592-42fd-abc8-1456aab0fc86', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c44f59-d4e3-4d59-91f5-e2dd6c2dffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Volume volume-7fece24f-e592-42fd-abc8-1456aab0fc86 (7fece24f-e592-42fd-abc8-1456aab0fc86): created successfully Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c44f59-d4e3-4d59-91f5-e2dd6c2dffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Flow 'volume_create_manager' (9f13fba4-9334-42dc-a37f-3ab41be19b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e6f37af4-7fa3-4d54-86c9-4d8027d32e2b tempest-ServersNegativeTestJSON-360587185 None] Created volume successfully. Sep 23 00:14:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "cinder-7fece24f-e592-42fd-abc8-1456aab0fc86-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-7fece24f-e592-42fd-abc8-1456aab0fc86-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "cinder-quobyte-7fece24f-e592-42fd-abc8-1456aab0fc86" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-quobyte-7fece24f-e592-42fd-abc8-1456aab0fc86" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6f6579-7d49-4d0e-b27b-11f2c5a62c40]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:49 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 Sep 23 00:14:49 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-52ad0800-26ed-4743-aa98-c75069953efd tempest-GroupSnapshotsV319Test-94813632 None] Group tempest-GroupSnapshotsV319Test-Group-1917685832: creating Sep 23 00:14:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-52ad0800-26ed-4743-aa98-c75069953efd tempest-GroupSnapshotsV319Test-94813632 None] Group tempest-GroupSnapshotsV319Test-Group-1917685832: created successfully Sep 23 00:14:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-52ad0800-26ed-4743-aa98-c75069953efd tempest-GroupSnapshotsV319Test-94813632 None] Create group completed successfully. Sep 23 00:14:49 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86" returned: 0 in 0.667s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:49 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86 Sep 23 00:14:49 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:49 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fece24f-e592-42fd-abc8-1456aab0fc86" returned: 0 in 0.377s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-quobyte-7fece24f-e592-42fd-abc8-1456aab0fc86" released by "delete_volume" :: held 1.136s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Created reservations ['17b2e233-c207-4857-821b-ef441627c234', 'fdcb06bc-f31d-4055-9042-2b9865e1d691', '6742e186-7bdc-4eb7-bb43-a61763da8ddd', '478b6183-512d-411e-af9b-62634e29219b', '8bf62276-1e21-4822-a6b5-dfc6ecd2f59f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:50 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:14:50 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:50 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Deleted volume successfully. Sep 23 00:14:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f45305e7-8ab9-4409-97d2-bb1fe1720b77 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-7fece24f-e592-42fd-abc8-1456aab0fc86-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "cinder-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "cinder-quobyte-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-quobyte-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a10762a-fcc7-469c-9f66-223348c76597]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe Sep 23 00:14:51 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Flow 'volume_create_manager' (f39dd47e-0a1d-4b25-9667-81b675ec0be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64737b87-04be-472b-a293-e53e7c499918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64737b87-04be-472b-a293-e53e7c499918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814914574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e2c35bf-45f1-417b-acc2-054bb813aa76,host='devstack@QuobyteHD#QuobyteHD',id=cc95020f-b227-4ca6-b0c9-1590130cf3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a80d16025914ac6864dfa7d8d305e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:51Z,use_quota=True,user_id='96b48a0490aa4c74a5a709718b080337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b62cb32c-99f9-4e42-aaaa-ba6b94db756c),volume_type_id=b62cb32c-99f9-4e42-aaaa-ba6b94db756c)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e0dd0a-ad38-459e-bcf6-c81f9c0af47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e0dd0a-ad38-459e-bcf6-c81f9c0af47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab28173-1b72-4769-b4b8-05757022534d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab28173-1b72-4769-b4b8-05757022534d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc95020f-b227-4ca6-b0c9-1590130cf3b2', 'volume_name': 'volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763cf9f5-00be-40c1-87b9-1f42efb8ec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763cf9f5-00be-40c1-87b9-1f42efb8ec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3f87ef-77ec-4162-8a6f-efe9c3edb78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:51 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Volume cc95020f-b227-4ca6-b0c9-1590130cf3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2', 'volume_size': 1} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e2c35bf-45f1-417b-acc2-054bb813aa76,created_at=2026-09-22T22:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814914574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e2c35bf-45f1-417b-acc2-054bb813aa76,host='devstack@QuobyteHD#QuobyteHD',id=cc95020f-b227-4ca6-b0c9-1590130cf3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a80d16025914ac6864dfa7d8d305e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:51Z,use_quota=True,user_id='96b48a0490aa4c74a5a709718b080337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b62cb32c-99f9-4e42-aaaa-ba6b94db756c),volume_type_id=b62cb32c-99f9-4e42-aaaa-ba6b94db756c)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Creating volume cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:51 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 1073741824 Sep 23 00:14:51 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:51 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe" returned: 0 in 0.467s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe Sep 23 00:14:51 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:52 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe" returned: 0 in 0.333s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-quobyte-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe" released by "delete_volume" :: held 0.880s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Created reservations ['9044b5eb-9117-41be-b167-86070d041d53', 'fb21fbdc-6b44-459f-b09d-bbbeeed4f3a5', '67ba4e70-041d-45d9-96f4-f559c43cd896', '8d565f92-9074-4faa-8318-1aaa6a89b080', 'f6c9cca8-662b-4fef-8315-2f9466a5b0d4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:14:52 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 1073741824" returned: 0 in 0.551s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:52 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 Sep 23 00:14:52 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:52 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:14:52 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:52 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:52 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2" returned: 0 in 0.397s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.346s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Deleted volume successfully. Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3f87ef-77ec-4162-8a6f-efe9c3edb78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0534925-badb-486c-bca0-ecfa0472a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4375dbd2-ac7a-43d4-9089-e9e90ba09ba8 tempest-ServersNegativeTestJSON-360587185 None] Lock "cinder-ba8ba2b8-ffd0-4731-94cf-42c01690ecbe-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:52 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Volume volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 (cc95020f-b227-4ca6-b0c9-1590130cf3b2): created successfully Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0534925-badb-486c-bca0-ecfa0472a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Flow 'volume_create_manager' (f39dd47e-0a1d-4b25-9667-81b675ec0be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ea8c973a-f3c0-40fb-8f51-a869ddbc9a31 tempest-GroupSnapshotsV319Test-94813632 None] Created volume successfully. Sep 23 00:14:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] GroupSnapshot 03c20bac-fcc6-4221-bf30-f6ed67c04d10: creating. Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Group snapshot 03c20bac-fcc6-4221-bf30-f6ed67c04d10: creating. {{(pid=87292) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Creating offline snapshot 0683d2af-af7c-4648-8089-7df8d737d638 of volume cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd5120-bd24-4f47-bb4f-f5ccf9579c3b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:54 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:14:54 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:54 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 Sep 23 00:14:54 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:55 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.520s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 8 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:55 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2" returned: 0 in 0.746s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:55 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 1G Sep 23 00:14:55 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:56 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 1G" returned: 0 in 0.615s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:56 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 Sep 23 00:14:56 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:56 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638" returned: 0 in 0.586s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:56 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:14:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:56 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 Sep 23 00:14:56 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:57 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638" returned: 0 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:57 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info Sep 23 00:14:57 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:57 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info" returned: 0 in 0.476s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:57 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:14:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:57 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info Sep 23 00:14:57 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:57 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.info" returned: 0 in 0.445s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3adb4a18-26cd-4cd4-8757-acc4cdebe893 tempest-GroupSnapshotsV319Test-94813632 None] group_snapshot 03c20bac-fcc6-4221-bf30-f6ed67c04d10: created successfully Sep 23 00:14:59 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] group_snapshot 03c20bac-fcc6-4221-bf30-f6ed67c04d10: deleting Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] group_snapshot 03c20bac-fcc6-4221-bf30-f6ed67c04d10: deleting {{(pid=87292) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "cinder-quobyte-cc95020f-b227-4ca6-b0c9-1590130cf3b2" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Lock "cinder-quobyte-cc95020f-b227-4ca6-b0c9-1590130cf3b2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "cinder-quobyte-0683d2af-af7c-4648-8089-7df8d737d638" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Lock "cinder-quobyte-0683d2af-af7c-4648-8089-7df8d737d638" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Deleting offline snapshot 0683d2af-af7c-4648-8089-7df8d737d638 of volume cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] snapshot_file for this snap is: volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd751c8-2f23-4920-8a25-b44df037eca9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:59 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 Sep 23 00:14:59 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:00 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638" returned: 0 in 0.477s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:00 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08f6cd5-5cbd-497f-a6dd-442aebc6e71f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:00 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 Sep 23 00:15:00 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:00 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2" returned: 0 in 0.484s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:00 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 Sep 23 00:15:00 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:01 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638" returned: 0 in 0.590s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:01 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638 Sep 23 00:15:01 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:01 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2.0683d2af-af7c-4648-8089-7df8d737d638" returned: 0 in 0.380s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Lock "cinder-quobyte-0683d2af-af7c-4648-8089-7df8d737d638" released by "_delete_snapshot" :: held 2.079s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Lock "cinder-quobyte-cc95020f-b227-4ca6-b0c9-1590130cf3b2" released by "delete_snapshot" :: held 2.114s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:01 devstack cinder-volume[87292]: WARNING cinder.quota [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1723109834 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1723109834, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:01 devstack cinder-volume[87292]: WARNING cinder.quota [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1723109834 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1723109834, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:02 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] Created reservations ['eda093e2-cd47-43e0-b566-0a2adec84544', 'bfe3481e-9f10-4452-98a8-a0f2de92fc12', '763e1b0a-4f44-466e-91b3-f66855efb791', 'a530ead1-5d74-4d21-8253-89542e2b2ab8', '5aeaea02-1860-4d1e-85e2-6dccafcad72c'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-154f6290-8cdd-48cd-9b10-63c1ea79cceb tempest-GroupSnapshotsV319Test-94813632 None] group_snapshot 03c20bac-fcc6-4221-bf30-f6ed67c04d10: deleted successfully Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Flow 'volume_create_manager' (b24e1062-ff05-492f-b103-c12d9ee5acd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a0eb97-80d2-4955-bca2-4ad45318eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a0eb97-80d2-4955-bca2-4ad45318eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-416447962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917e8f8d-901a-4b42-8cf0-c9006e940917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='135fe5d5a3894335949966b008b855ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:03Z,use_quota=True,user_id='b8cbacf19cce44a3b89cf116650aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4d633b-af10-4280-bbc7-9618878c141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4d633b-af10-4280-bbc7-9618878c141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c7cf1f-e348-4e1f-9d6a-ed3136f71c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c7cf1f-e348-4e1f-9d6a-ed3136f71c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917e8f8d-901a-4b42-8cf0-c9006e940917', 'volume_name': 'volume-917e8f8d-901a-4b42-8cf0-c9006e940917', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd83d20-092b-44c8-aea0-974125a1b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd83d20-092b-44c8-aea0-974125a1b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3137ce96-9f49-4995-93f9-56866e01e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Volume 917e8f8d-901a-4b42-8cf0-c9006e940917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917e8f8d-901a-4b42-8cf0-c9006e940917', 'volume_size': 1} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-416447962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917e8f8d-901a-4b42-8cf0-c9006e940917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='135fe5d5a3894335949966b008b855ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:03Z,use_quota=True,user_id='b8cbacf19cce44a3b89cf116650aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Creating volume 917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:03 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:03 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 1073741824 Sep 23 00:15:03 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "cinder-quobyte-cc95020f-b227-4ca6-b0c9-1590130cf3b2" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Lock "cinder-quobyte-cc95020f-b227-4ca6-b0c9-1590130cf3b2" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[784d4dcd-9b54-4768-9463-bb18fc35d140]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:03 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 Sep 23 00:15:03 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 1073741824" returned: 0 in 0.699s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 Sep 23 00:15:04 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:04 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2" returned: 0 in 0.657s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2 Sep 23 00:15:04 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:04 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917" returned: 0 in 0.395s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3137ce96-9f49-4995-93f9-56866e01e053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917e8f8d-901a-4b42-8cf0-c9006e940917', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eada6c-52ce-466a-8774-477bf2bde17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Volume volume-917e8f8d-901a-4b42-8cf0-c9006e940917 (917e8f8d-901a-4b42-8cf0-c9006e940917): created successfully Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eada6c-52ce-466a-8774-477bf2bde17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Flow 'volume_create_manager' (b24e1062-ff05-492f-b103-c12d9ee5acd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-5c01327e-c0f4-40e9-9624-92029aa69db9 req-19759c11-6aa5-479a-8317-d72fa6ccc356 tempest-VolumesSnapshotsTestJSON-1765626342 None] Created volume successfully. Sep 23 00:15:04 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cc95020f-b227-4ca6-b0c9-1590130cf3b2" returned: 0 in 0.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Lock "cinder-quobyte-cc95020f-b227-4ca6-b0c9-1590130cf3b2" released by "delete_volume" :: held 1.100s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Created reservations ['2b6c8f7f-bdf8-4242-b21b-77f3aa579344'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:04 devstack cinder-volume[87292]: WARNING cinder.quota [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1723109834 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1723109834, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Created reservations ['af3efe80-0700-4233-b38d-9f03499afc89', 'db000996-361a-4969-afe8-068c043ce9f9', 'cc81db32-287d-45ab-9448-dfad0130d925', 'db6ea751-b57d-42f7-95b4-46f582f36dc1', '0bcac23c-4ea4-4618-b07f-d808ae6e1261'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:15:04 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:05 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.283s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fe855efe-3b7c-4811-b320-87ad8b0d8f3c tempest-GroupSnapshotsV319Test-94813632 None] Delete group completed successfully. Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Creating offline snapshot 8d2ac70e-303b-4b3e-a235-3689589d1b68 of volume 917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd019fd7-37ed-44a2-974c-f95fd0012197]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:06 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 Sep 23 00:15:06 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917" returned: 0 in 0.561s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:06 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 1G Sep 23 00:15:06 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 1G" returned: 0 in 0.575s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e8f8d-901a-4b42-8cf0-c9006e940917 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e8f8d-901a-4b42-8cf0-c9006e940917 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 Sep 23 00:15:07 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e8f8d-901a-4b42-8cf0-c9006e940917 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68" returned: 0 in 0.427s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 is being set with open permissions: ugo+rw Sep 23 00:15:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 Sep 23 00:15:07 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68" returned: 0 in 0.393s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info Sep 23 00:15:07 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info" returned: 0 in 0.430s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info is being set with open permissions: ugo+rw Sep 23 00:15:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info Sep 23 00:15:08 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.info" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.921s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-7d1d7ef1-ca86-470e-af0d-bf9eb445aedd req-3a14d38d-c38c-4179-a48f-450a881558d3 tempest-VolumesSnapshotsTestJSON-1765626342 None] Create snapshot completed successfully Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "cinder-8d2ac70e-303b-4b3e-a235-3689589d1b68-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-8d2ac70e-303b-4b3e-a235-3689589d1b68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "cinder-quobyte-917e8f8d-901a-4b42-8cf0-c9006e940917" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-quobyte-917e8f8d-901a-4b42-8cf0-c9006e940917" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "cinder-quobyte-8d2ac70e-303b-4b3e-a235-3689589d1b68" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-quobyte-8d2ac70e-303b-4b3e-a235-3689589d1b68" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Deleting offline snapshot 8d2ac70e-303b-4b3e-a235-3689589d1b68 of volume 917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] snapshot_file for this snap is: volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[261380b9-b62a-45e2-b886-a92ed3cff2bd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 Sep 23 00:15:10 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:10 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68" returned: 0 in 0.579s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917e8f8d-901a-4b42-8cf0-c9006e940917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:10 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3712cb1-3ac8-405f-beed-8ef92911fd69]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 Sep 23 00:15:10 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917" returned: 0 in 0.550s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:11 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 Sep 23 00:15:11 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68" returned: 0 in 0.394s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:11 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68 Sep 23 00:15:11 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917.8d2ac70e-303b-4b3e-a235-3689589d1b68" returned: 0 in 0.350s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-quobyte-8d2ac70e-303b-4b3e-a235-3689589d1b68" released by "_delete_snapshot" :: held 2.063s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-quobyte-917e8f8d-901a-4b42-8cf0-c9006e940917" released by "delete_snapshot" :: held 2.108s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:12 devstack cinder-volume[87292]: WARNING cinder.quota [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:12 devstack cinder-volume[87292]: DEBUG cinder.quota [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Created reservations ['f132825a-e083-4196-aba5-2922421a23a3', '70e79370-3d80-4e6b-9463-2767e2027443', 'cad5630b-88b4-44a2-bbf2-3cd355788ce4', 'b6d606f5-32a2-48b5-8c41-d9e2350c409a', '75b799ad-8ba3-4ee1-bab3-fb48417041c4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Delete snapshot completed successfully. Sep 23 00:15:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-599567a3-a66c-4841-8c11-2ca2fc669cff req-b182a561-8e9c-4be4-808a-dd479ffbbe59 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-8d2ac70e-303b-4b3e-a235-3689589d1b68-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "cinder-917e8f8d-901a-4b42-8cf0-c9006e940917-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-917e8f8d-901a-4b42-8cf0-c9006e940917-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Flow 'volume_create_manager' (3c5223ac-3168-4faa-924d-826df563c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f49a11c-e191-4df1-9d71-171cd53a325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f49a11c-e191-4df1-9d71-171cd53a325e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-525929825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0654b83-5657-4511-b577-17e56379f28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c335e69951f43c2bc1b86270b71ec7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:14Z,use_quota=True,user_id='db09e1c7a25e4b6c8dd29e55a4dd37f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9974666-5e12-4107-8858-30c77ce74c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9974666-5e12-4107-8858-30c77ce74c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f043e86f-e478-4779-9066-40d113784aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f043e86f-e478-4779-9066-40d113784aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0654b83-5657-4511-b577-17e56379f28b', 'volume_name': 'volume-a0654b83-5657-4511-b577-17e56379f28b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f299f8a8-e5d7-48c6-91c4-37fc4fb58f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f299f8a8-e5d7-48c6-91c4-37fc4fb58f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ebcc67-f244-46ba-84d7-4f8a1c7e79d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:14 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Volume a0654b83-5657-4511-b577-17e56379f28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0654b83-5657-4511-b577-17e56379f28b', 'volume_size': 1} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-525929825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0654b83-5657-4511-b577-17e56379f28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c335e69951f43c2bc1b86270b71ec7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:14Z,use_quota=True,user_id='db09e1c7a25e4b6c8dd29e55a4dd37f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Creating volume a0654b83-5657-4511-b577-17e56379f28b {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:14 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "cinder-quobyte-917e8f8d-901a-4b42-8cf0-c9006e940917" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:14 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b 1073741824 Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-quobyte-917e8f8d-901a-4b42-8cf0-c9006e940917" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:14 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ff8c4-9718-4585-8fcf-5c9d5aec1907]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-dacce2a4-7d71-4442-9b9b-a0f3c4bf595c tempest-GroupsV314Test-239047482 None] Group tempest-GroupsV314Test-Group-940361578: creating Sep 23 00:15:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-dacce2a4-7d71-4442-9b9b-a0f3c4bf595c tempest-GroupsV314Test-239047482 None] Group tempest-GroupsV314Test-Group-940361578: created successfully Sep 23 00:15:14 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 Sep 23 00:15:14 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-dacce2a4-7d71-4442-9b9b-a0f3c4bf595c tempest-GroupsV314Test-239047482 None] Create group completed successfully. Sep 23 00:15:14 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b 1073741824" returned: 0 in 0.835s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:14 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917" returned: 0 in 0.735s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:14 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b Sep 23 00:15:14 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:15 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917 Sep 23 00:15:15 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:15 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:15 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b" returned: 0 in 0.491s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-917e8f8d-901a-4b42-8cf0-c9006e940917" returned: 0 in 0.479s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ebcc67-f244-46ba-84d7-4f8a1c7e79d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0654b83-5657-4511-b577-17e56379f28b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e7b8e9-146b-474d-b712-bb69c574ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-quobyte-917e8f8d-901a-4b42-8cf0-c9006e940917" released by "delete_volume" :: held 1.402s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:15 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Volume volume-a0654b83-5657-4511-b577-17e56379f28b (a0654b83-5657-4511-b577-17e56379f28b): created successfully Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e7b8e9-146b-474d-b712-bb69c574ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Flow 'volume_create_manager' (3c5223ac-3168-4faa-924d-826df563c235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-136e8313-776f-4716-9f7f-f168885986a4 tempest-ServerActionsTestOtherA-774435999 None] Created volume successfully. Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.quota [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Created reservations ['8205ae53-f5ec-4909-99bb-90fb16222f09', '2dfbe013-3537-40ca-8d1e-fccbd8a6da5a', '73214c9c-57f9-4db6-bde0-a76d87adda10', '444a9861-92cd-44a5-829a-1953e2aee735', '894a7aed-1a46-4813-b510-477111eb4ae3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:15 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:15:15 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:16 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.591s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.manager [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Deleted volume successfully. Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-87618adc-99aa-41e1-8aa2-bf7dc0f3d669 req-de892281-ca63-4fb4-9df0-cd4a3ece4444 tempest-VolumesSnapshotsTestJSON-1765626342 None] Lock "cinder-917e8f8d-901a-4b42-8cf0-c9006e940917-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Flow 'volume_create_manager' (f9811778-0fc1-439d-821a-5129c9d3fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b33b066-51f6-4a79-81b8-b3616083d1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b33b066-51f6-4a79-81b8-b3616083d1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1461394606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06f75782-eed3-4e50-b22e-38fa2d7087c6,host='devstack@QuobyteHD#QuobyteHD',id=fd19600a-5054-448f-8b0a-5092743d41e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c1377668314ea2a79b036fb8b006ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:16Z,use_quota=True,user_id='13b7577aa55146728c86d6b9a4c507f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91f8f13e-b160-4bfb-a042-20bfb01650b9),volume_type_id=91f8f13e-b160-4bfb-a042-20bfb01650b9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bd031e-4dba-4562-947e-7b3470ae479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bd031e-4dba-4562-947e-7b3470ae479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafb6ceb-e5c8-4e8e-b22e-5d17bfa8b0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafb6ceb-e5c8-4e8e-b22e-5d17bfa8b0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd19600a-5054-448f-8b0a-5092743d41e1', 'volume_name': 'volume-fd19600a-5054-448f-8b0a-5092743d41e1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35f462f-b61c-4a82-8273-1e9a4b4c1571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35f462f-b61c-4a82-8273-1e9a4b4c1571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a142e417-440e-42db-8af2-f84d9f88f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:16 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Volume fd19600a-5054-448f-8b0a-5092743d41e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd19600a-5054-448f-8b0a-5092743d41e1', 'volume_size': 1} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06f75782-eed3-4e50-b22e-38fa2d7087c6,created_at=2026-09-22T22:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1461394606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06f75782-eed3-4e50-b22e-38fa2d7087c6,host='devstack@QuobyteHD#QuobyteHD',id=fd19600a-5054-448f-8b0a-5092743d41e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c1377668314ea2a79b036fb8b006ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:16Z,use_quota=True,user_id='13b7577aa55146728c86d6b9a4c507f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91f8f13e-b160-4bfb-a042-20bfb01650b9),volume_type_id=91f8f13e-b160-4bfb-a042-20bfb01650b9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Creating volume fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:16 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:15:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:16 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 1073741824 Sep 23 00:15:16 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:17 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 1073741824" returned: 0 in 0.886s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:17 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 Sep 23 00:15:17 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:18 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1" returned: 0 in 0.485s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a142e417-440e-42db-8af2-f84d9f88f497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd19600a-5054-448f-8b0a-5092743d41e1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633abd65-c0c8-42a8-9fc6-2354a34f2c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Volume volume-fd19600a-5054-448f-8b0a-5092743d41e1 (fd19600a-5054-448f-8b0a-5092743d41e1): created successfully Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633abd65-c0c8-42a8-9fc6-2354a34f2c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Flow 'volume_create_manager' (f9811778-0fc1-439d-821a-5129c9d3fac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3c2c3785-d132-4372-851e-79468fa7048e tempest-GroupsV314Test-239047482 None] Created volume successfully. Sep 23 00:15:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:20 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Cloning volume fd19600a-5054-448f-8b0a-5092743d41e1 to volume fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff Sep 23 00:15:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Creating offline snapshot 86972298-78b8-4668-9648-1fb5760d7f08 of volume fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e09c856-95f9-43ef-b2ed-085eeccef016]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:20 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 Sep 23 00:15:20 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:21 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1" returned: 0 in 0.744s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:21 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 1G Sep 23 00:15:21 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:21 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 1G" returned: 0 in 0.616s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19600a-5054-448f-8b0a-5092743d41e1 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:21 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19600a-5054-448f-8b0a-5092743d41e1 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 Sep 23 00:15:21 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:22 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19600a-5054-448f-8b0a-5092743d41e1 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08" returned: 0 in 0.440s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:22 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:22 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 Sep 23 00:15:22 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:22 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08" returned: 0 in 0.374s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:22 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info Sep 23 00:15:22 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:23 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info" returned: 0 in 0.449s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:23 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:23 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info Sep 23 00:15:23 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:23 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.info" returned: 0 in 0.412s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Acquiring lock "cinder-quobyte-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] snapshot: 86972298-78b8-4668-9648-1fb5760d7f08, volume: fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[27457ad9-0527-49ed-b1da-527a25565783]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:23 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 Sep 23 00:15:23 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:24 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08" returned: 0 in 0.704s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19600a-5054-448f-8b0a-5092743d41e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:24 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41575412-7a3f-4fee-a640-93f2ea507e2e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:24 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 Sep 23 00:15:24 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:25 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1" returned: 0 in 0.792s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:15:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:15:25 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:15:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff Sep 23 00:15:25 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:32 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=82,cinder:SELECT=82,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:32 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=74,cinder:UPDATE=90,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-987f15db-5f6b-43d0-917f-d3439c826f88 tempest-GroupSnapshotsTest-1254787139 None] Group tempest-GroupSnapshotsTest-Group-1686047247: creating Sep 23 00:15:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-987f15db-5f6b-43d0-917f-d3439c826f88 tempest-GroupSnapshotsTest-1254787139 None] Group tempest-GroupSnapshotsTest-Group-1686047247: created successfully Sep 23 00:15:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-987f15db-5f6b-43d0-917f-d3439c826f88 tempest-GroupSnapshotsTest-1254787139 None] Create group completed successfully. Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (e6199723-df52-4431-861b-a18688733bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefbc3e7-888c-4b87-af02-4c52463ff820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefbc3e7-888c-4b87-af02-4c52463ff820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378592798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45956ea9-5eff-4fcf-8152-77ce5201c1a8,host='devstack@QuobyteHD#QuobyteHD',id=5ff628dc-e636-4f80-aa88-fa0841d0887f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:38Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(891f1016-aad9-456f-9529-c713fc049043),volume_type_id=891f1016-aad9-456f-9529-c713fc049043)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93063b4f-adab-4bea-9db4-05ea851abb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93063b4f-adab-4bea-9db4-05ea851abb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54247f97-43fe-4f67-a8b0-6ef91c09c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54247f97-43fe-4f67-a8b0-6ef91c09c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff628dc-e636-4f80-aa88-fa0841d0887f', 'volume_name': 'volume-5ff628dc-e636-4f80-aa88-fa0841d0887f', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbfa6bc-c848-458e-9388-306e13086cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:38 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbfa6bc-c848-458e-9388-306e13086cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbfe23c-25fe-4987-b887-948b9976c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Volume 5ff628dc-e636-4f80-aa88-fa0841d0887f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff628dc-e636-4f80-aa88-fa0841d0887f', 'volume_size': 1} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" returned: 0 in 13.766s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1, size 1024.00 MB, duration 13.77 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:38 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Converted 1024.00 MB image at 74.38 MB/s Sep 23 00:15:38 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff Sep 23 00:15:39 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:39 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" returned: 0 in 0.496s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" released by "_copy_volume_from_snapshot" :: held 15.912s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Acquiring lock "cinder-quobyte-86972298-78b8-4668-9648-1fb5760d7f08" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-86972298-78b8-4668-9648-1fb5760d7f08" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Deleting offline snapshot 86972298-78b8-4668-9648-1fb5760d7f08 of volume fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] snapshot_file for this snap is: volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4c136-477f-48cc-a819-5e2139be6492]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 Sep 23 00:15:39 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:40 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08" returned: 0 in 1.010s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19600a-5054-448f-8b0a-5092743d41e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068874f-b235-4b75-9829-1aac897a989d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:41 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 Sep 23 00:15:41 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1" returned: 0 in 1.699s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 Sep 23 00:15:42 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08" returned: 0 in 1.139s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08 Sep 23 00:15:43 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1.86972298-78b8-4668-9648-1fb5760d7f08" returned: 0 in 0.488s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-86972298-78b8-4668-9648-1fb5760d7f08" released by "_delete_snapshot" :: held 4.591s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.282s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=45956ea9-5eff-4fcf-8152-77ce5201c1a8,created_at=2026-09-22T22:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378592798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45956ea9-5eff-4fcf-8152-77ce5201c1a8,host='devstack@QuobyteHD#QuobyteHD',id=5ff628dc-e636-4f80-aa88-fa0841d0887f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:38Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(891f1016-aad9-456f-9529-c713fc049043),volume_type_id=891f1016-aad9-456f-9529-c713fc049043)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Creating volume 5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:44 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:15:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f 1073741824 Sep 23 00:15:44 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2f8f8ab8-0621-4036-804b-4d1b8656a68e tempest-GroupsV314Test-239047482 None] Create group from source-group-06f75782-eed3-4e50-b22e-38fa2d7087c6 completed successfully. Sep 23 00:15:45 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f 1073741824" returned: 0 in 1.149s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:45 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f Sep 23 00:15:45 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Acquiring lock "cinder-quobyte-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:46 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f" returned: 0 in 0.751s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbfe23c-25fe-4987-b887-948b9976c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff628dc-e636-4f80-aa88-fa0841d0887f', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bf7cb6-755c-4599-85de-929bac86bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d5cb45-f419-4f38-92c8-420d8f8c0742]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Volume volume-5ff628dc-e636-4f80-aa88-fa0841d0887f (5ff628dc-e636-4f80-aa88-fa0841d0887f): created successfully Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bf7cb6-755c-4599-85de-929bac86bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (e6199723-df52-4431-861b-a18688733bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:46 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff Sep 23 00:15:46 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-13ea7680-a2c6-43fe-8372-899fa8df6c3a tempest-GroupSnapshotsTest-1254787139 None] Created volume successfully. Sep 23 00:15:46 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" returned: 0 in 0.557s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff Sep 23 00:15:46 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:47 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" returned: 0 in 0.482s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-fa30163f-04d8-4ab4-b1c9-1b1c616ae1ff" released by "delete_volume" :: held 1.183s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:47 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Created reservations ['6f4f0cb2-68ae-4ea5-99b9-7d9af1a48e96'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:47 devstack cinder-volume[87292]: WARNING cinder.quota [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-271511522 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-271511522, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:47 devstack cinder-volume[87292]: WARNING cinder.quota [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-271511522 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-271511522, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:47 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Created reservations ['ca7865ff-36f3-481e-9ff7-952d9cffe644', '21710693-5614-491a-b661-56bd27586c17', '0625cd47-3de0-4886-a974-ef7a826516ba', 'f023459a-f3a6-4b09-875d-bc83dbbfff75', 'fa068492-d779-4e3b-90a7-4ff72be5972d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:48 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:15:48 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] GroupSnapshot 8458a367-6dbd-4344-9106-ea8265837e13: creating. Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Group snapshot 8458a367-6dbd-4344-9106-ea8265837e13: creating. {{(pid=87292) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Creating offline snapshot 74fee472-51f5-475b-9b5a-ed3de1ed6148 of volume 5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d84d7-bddd-4797-8a5c-1f56786480d0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:48 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.407s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0fa2bc02-0e69-4e1a-9945-91f832c1c861 tempest-GroupsV314Test-239047482 None] Delete group completed successfully. Sep 23 00:15:48 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f Sep 23 00:15:48 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:48 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f" returned: 0 in 0.539s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:48 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 1G Sep 23 00:15:48 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:49 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 1G" returned: 0 in 0.592s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff628dc-e636-4f80-aa88-fa0841d0887f -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:49 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff628dc-e636-4f80-aa88-fa0841d0887f -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 Sep 23 00:15:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Acquiring lock "cinder-quobyte-fd19600a-5054-448f-8b0a-5092743d41e1" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:49 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-fd19600a-5054-448f-8b0a-5092743d41e1" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d9e7c8-2806-4c98-84ad-a04b490725cc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:49 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 Sep 23 00:15:49 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff628dc-e636-4f80-aa88-fa0841d0887f -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148" returned: 0 in 0.753s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:50 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 Sep 23 00:15:50 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1" returned: 0 in 0.733s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:50 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1 Sep 23 00:15:50 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148" returned: 0 in 0.448s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:50 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info Sep 23 00:15:50 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:51 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fd19600a-5054-448f-8b0a-5092743d41e1" returned: 0 in 0.706s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Lock "cinder-quobyte-fd19600a-5054-448f-8b0a-5092743d41e1" released by "delete_volume" :: held 1.625s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:51 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info" returned: 0 in 0.615s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:51 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:51 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Created reservations ['9104938e-9802-48a2-9f49-4df9237e01ef'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:51 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Created reservations ['54ef714f-6e51-47f1-a992-3ecda0ae51d2', 'ae4507a8-dafd-45e5-a4fd-b35a628f5396', '9e3e193c-e657-4c1b-a702-148a53dc3fd0', 'ebbe0024-5641-49e9-a1e0-4582714dc246', '063b994d-7eae-4150-8394-b06d3655617f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:51 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.info" returned: 0 in 0.584s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:51 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:15:51 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.692s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4638ca99-9244-4da8-b6f7-305710796f0c tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 8458a367-6dbd-4344-9106-ea8265837e13: created successfully Sep 23 00:15:52 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.395s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:52 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9b1862c8-2bf0-40b6-a141-1706c54b37e8 tempest-GroupsV314Test-239047482 None] Delete group completed successfully. Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-74fee472-51f5-475b-9b5a-ed3de1ed6148-0f0249fd-9146-456a-9a9b-4f93f5d626fd" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-74fee472-51f5-475b-9b5a-ed3de1ed6148-0f0249fd-9146-456a-9a9b-4f93f5d626fd" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Creating volume 0f0249fd-9146-456a-9a9b-4f93f5d626fd from snapshot 74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-0f0249fd-9146-456a-9a9b-4f93f5d626fd" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-0f0249fd-9146-456a-9a9b-4f93f5d626fd" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] snapshot: 74fee472-51f5-475b-9b5a-ed3de1ed6148, volume: 0f0249fd-9146-456a-9a9b-4f93f5d626fd, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[523aaede-4de5-4519-8fed-77c89582e70e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:54 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 Sep 23 00:15:54 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:54 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148" returned: 0 in 0.614s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ff628dc-e636-4f80-aa88-fa0841d0887f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b9618c-c019-4ac3-b77e-4d388e31a083]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 8 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:15:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:15:54 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f Sep 23 00:15:54 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:55 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f" returned: 0 in 0.592s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:15:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:15:55 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:15:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:55 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd Sep 23 00:15:55 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=32,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=32,cinder:UPDATE=39,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:04 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd" returned: 0 in 9.420s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:04 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f, size 1024.00 MB, duration 9.42 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:04 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Converted 1024.00 MB image at 108.70 MB/s Sep 23 00:16:04 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:04 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd Sep 23 00:16:04 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:05 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd" returned: 0 in 0.313s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-0f0249fd-9146-456a-9a9b-4f93f5d626fd" released by "_copy_volume_from_snapshot" :: held 11.091s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-74fee472-51f5-475b-9b5a-ed3de1ed6148-0f0249fd-9146-456a-9a9b-4f93f5d626fd" released by "_create_volume_from_snapshot" :: held 11.208s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.253s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-20df436d-1c77-4bf7-8103-24af2bb7d934 tempest-GroupSnapshotsTest-1254787139 None] Create group from source-snapshot-8458a367-6dbd-4344-9106-ea8265837e13 completed successfully. Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-af00c83d-bfbd-4ac6-a8fe-72c3541c90fc req-b542768c-399f-455b-89e4-44973c392566 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-af00c83d-bfbd-4ac6-a8fe-72c3541c90fc req-b542768c-399f-455b-89e4-44973c392566 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-af00c83d-bfbd-4ac6-a8fe-72c3541c90fc req-b542768c-399f-455b-89e4-44973c392566 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-af00c83d-bfbd-4ac6-a8fe-72c3541c90fc req-b542768c-399f-455b-89e4-44973c392566 tempest-ServerActionsTestOtherA-774435999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-a0654b83-5657-4511-b577-17e56379f28b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca5bfe99-cff1-4543-8902-bf06414da2bc', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Flow 'volume_create_manager' (7e5a0110-608f-4610-9bd4-800e3096330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966075ba-2dee-44ff-9318-b51aaccedcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966075ba-2dee-44ff-9318-b51aaccedcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1632446364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad1a15e-31fc-4894-8569-f7b7683ed89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d525eb54d4cebba188e387f54c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:07Z,use_quota=True,user_id='4f912d03f95044c2831c58a0b0b9f573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2d9576-c152-4382-bd51-580f5a57c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2d9576-c152-4382-bd51-580f5a57c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75161abf-8183-4ec3-93a8-7977a0116049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75161abf-8183-4ec3-93a8-7977a0116049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad1a15e-31fc-4894-8569-f7b7683ed89a', 'volume_name': 'volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0e7c33-888d-4ca7-aac1-b7614e3619bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0e7c33-888d-4ca7-aac1-b7614e3619bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722d52e8-441a-44ff-954e-c794bdf516cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a', 'volume_size': 1} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1632446364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad1a15e-31fc-4894-8569-f7b7683ed89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d525eb54d4cebba188e387f54c9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:07Z,use_quota=True,user_id='4f912d03f95044c2831c58a0b0b9f573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Creating volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:06 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:16:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-af00c83d-bfbd-4ac6-a8fe-72c3541c90fc req-b542768c-399f-455b-89e4-44973c392566 tempest-ServerActionsTestOtherA-774435999 None] attachment_update completed successfully. Sep 23 00:16:06 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a 1073741824 Sep 23 00:16:06 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-0f0249fd-9146-456a-9a9b-4f93f5d626fd" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-0f0249fd-9146-456a-9a9b-4f93f5d626fd" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0018fb-03a5-47d2-848b-9decde7433dd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:07 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd Sep 23 00:16:07 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:07 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a 1073741824" returned: 0 in 0.700s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:07 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a Sep 23 00:16:07 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:07 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd" returned: 0 in 0.567s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:07 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd Sep 23 00:16:07 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:07 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a" returned: 0 in 0.343s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722d52e8-441a-44ff-954e-c794bdf516cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1b3514-f6f2-44ab-ab9c-34b01d9d4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:07 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Volume volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a (3ad1a15e-31fc-4894-8569-f7b7683ed89a): created successfully Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1b3514-f6f2-44ab-ab9c-34b01d9d4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Flow 'volume_create_manager' (7e5a0110-608f-4610-9bd4-800e3096330d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-800eabc3-4dd7-4613-8e09-281575bdce0c tempest-SnapshotsActionsTest-466896839 None] Created volume successfully. Sep 23 00:16:08 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0f0249fd-9146-456a-9a9b-4f93f5d626fd" returned: 0 in 0.333s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-0f0249fd-9146-456a-9a9b-4f93f5d626fd" released by "delete_volume" :: held 0.978s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['f85a9e0d-065e-4413-8b4d-4b87b99db44f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:08 devstack cinder-volume[87292]: WARNING cinder.quota [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1775547297 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1775547297, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:08 devstack cinder-volume[87292]: WARNING cinder.quota [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1775547297 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1775547297, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['15eb881b-19e1-401e-90f5-e9e176492333', 'b9b7160d-6df0-4021-bde4-2ac8ac4f6a9f', 'b2581b1d-f9b7-438c-991c-360f432a967e', '081a930f-c0f0-4dcd-90c3-5304a87da1ac', '937da9c3-5604-4e79-a95c-8cefd79ded01'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:08 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:16:08 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 8458a367-6dbd-4344-9106-ea8265837e13: deleting Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 8458a367-6dbd-4344-9106-ea8265837e13: deleting {{(pid=87292) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-5ff628dc-e636-4f80-aa88-fa0841d0887f" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-5ff628dc-e636-4f80-aa88-fa0841d0887f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-74fee472-51f5-475b-9b5a-ed3de1ed6148" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-74fee472-51f5-475b-9b5a-ed3de1ed6148" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Deleting offline snapshot 74fee472-51f5-475b-9b5a-ed3de1ed6148 of volume 5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] snapshot_file for this snap is: volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1240e23-cd6d-4a79-b5bc-4bba6fb1d3df]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:08 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.357s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:08 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bff84c59-e3b6-40d5-897a-10a3cd7e6fcb tempest-GroupSnapshotsTest-1254787139 None] Delete group completed successfully. Sep 23 00:16:08 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 Sep 23 00:16:08 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:09 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148" returned: 0 in 0.544s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ff628dc-e636-4f80-aa88-fa0841d0887f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6abe42f-bcad-4238-9584-b0bfc94acdb7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:09 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f Sep 23 00:16:09 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Creating offline snapshot 5012f146-6ad5-48ba-a05f-714780fae791 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b920b3-bbdd-44fb-8d65-4596f9179710]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:09 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a Sep 23 00:16:09 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Flow 'volume_create_manager' (5071998f-33f4-48fb-9084-996dfc0faba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ec94fb-baf1-46f8-834b-85a327c4418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ec94fb-baf1-46f8-834b-85a327c4418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-231056124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3513900-68ba-41e0-b430-78d342f83f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eef771dabf4404fb9ca8bcf3cf33359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:10Z,use_quota=True,user_id='8e86f628aeac4fe5b942156923ba3eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfb4e50-54a5-467e-b486-c951edbaccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfb4e50-54a5-467e-b486-c951edbaccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38af313-7cb2-4aaf-b0e3-9d438e0292a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38af313-7cb2-4aaf-b0e3-9d438e0292a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3513900-68ba-41e0-b430-78d342f83f4f', 'volume_name': 'volume-b3513900-68ba-41e0-b430-78d342f83f4f', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac5eb93-f7f7-44a4-875b-843dc7444520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac5eb93-f7f7-44a4-875b-843dc7444520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edad963e-b1f6-4b66-8042-78c57fbfb1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:09 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Volume b3513900-68ba-41e0-b430-78d342f83f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3513900-68ba-41e0-b430-78d342f83f4f', 'volume_size': 1} Sep 23 00:16:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:10 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f" returned: 0 in 0.883s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:10 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 Sep 23 00:16:10 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:10 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a" returned: 0 in 0.691s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:10 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 1G Sep 23 00:16:10 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:10 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148" returned: 0 in 0.571s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:10 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148 Sep 23 00:16:10 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:10 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 1G" returned: 0 in 0.678s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:10 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:10 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:11 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f.74fee472-51f5-475b-9b5a-ed3de1ed6148" returned: 0 in 0.339s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-74fee472-51f5-475b-9b5a-ed3de1ed6148" released by "_delete_snapshot" :: held 2.505s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-5ff628dc-e636-4f80-aa88-fa0841d0887f" released by "delete_snapshot" :: held 2.543s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-bb618091-f726-4655-9fe3-90565668b333 req-e4dba97e-69b2-4340-b753-a572a0ceaab1 tempest-ServerActionsTestOtherA-774435999 None] Terminate volume connection completed successfully. Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-bb618091-f726-4655-9fe3-90565668b333 req-e4dba97e-69b2-4340-b753-a572a0ceaab1 tempest-ServerActionsTestOtherA-774435999 None] Deleting attachment ca5bfe99-cff1-4543-8902-bf06414da2bc. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:11 devstack cinder-volume[87292]: WARNING cinder.quota [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1775547297 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1775547297, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['04a98ef3-6e85-4d69-9feb-0aafdb732558', '1dc84f9e-703c-4c48-9009-38185d50a72e', '92a36931-ae4b-4358-9170-436127b2d755', '8e3ebe70-c67a-4d16-b267-36845fec150b', '669d2f17-30b0-423f-a998-c0d4c69662de'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:11 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.471s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:11 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 is being set with open permissions: ugo+rw Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:11 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:11 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d1ad0afc-dfc2-48ce-9baa-4d04f66a0fa0 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 8458a367-6dbd-4344-9106-ea8265837e13: deleted successfully Sep 23 00:16:11 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.569s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:12 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info Sep 23 00:16:12 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-5ff628dc-e636-4f80-aa88-fa0841d0887f" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-5ff628dc-e636-4f80-aa88-fa0841d0887f" acquired by "delete_volume" :: waited 0.048s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:12 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info" returned: 0 in 0.489s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:12 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info is being set with open permissions: ugo+rw Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-bb618091-f726-4655-9fe3-90565668b333 req-43975392-32b4-466a-9b0a-d943bcc55f31 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d146b-726a-4629-8f3d-391d2c5fa778]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:12 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info Sep 23 00:16:12 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:12 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f Sep 23 00:16:12 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:12 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.info" returned: 0 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.489s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.056s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-231056124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3513900-68ba-41e0-b430-78d342f83f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eef771dabf4404fb9ca8bcf3cf33359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:10Z,use_quota=True,user_id='8e86f628aeac4fe5b942156923ba3eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Creating volume b3513900-68ba-41e0-b430-78d342f83f4f {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:12 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:16:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:12 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f 1073741824 Sep 23 00:16:12 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f0dde9ae-ebd5-4069-947c-421518228103 tempest-SnapshotsActionsTest-466896839 None] Create snapshot completed successfully Sep 23 00:16:13 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f" returned: 0 in 0.507s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:13 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f Sep 23 00:16:13 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:13 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5ff628dc-e636-4f80-aa88-fa0841d0887f" returned: 0 in 0.361s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-5ff628dc-e636-4f80-aa88-fa0841d0887f" released by "delete_volume" :: held 0.985s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:13 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['4427032c-2125-4886-8201-e70879328265'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f 1073741824" returned: 0 in 0.570s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:13 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f Sep 23 00:16:13 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:13 devstack cinder-volume[87292]: WARNING cinder.db.api [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1775547297'] Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['298bfe3a-6ada-4ff8-b1b5-f25bd53a9e02', 'de7fc6ae-4fe7-4268-8945-ccd5d8b226f3', 'ec033b70-a0c1-4809-a845-ea961c343e3b', '9329357d-7513-4880-bdcf-ab945c816a5b', '32944a6b-b917-488e-a0b1-88f7edbb9738'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:13 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:16:13 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:13 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f" returned: 0 in 0.353s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-bb618091-f726-4655-9fe3-90565668b333 req-43975392-32b4-466a-9b0a-d943bcc55f31 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.390s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edad963e-b1f6-4b66-8042-78c57fbfb1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3513900-68ba-41e0-b430-78d342f83f4f', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1f016f-fcc5-4434-8781-e55d4074eb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-bb618091-f726-4655-9fe3-90565668b333 req-43975392-32b4-466a-9b0a-d943bcc55f31 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Volume volume-b3513900-68ba-41e0-b430-78d342f83f4f (b3513900-68ba-41e0-b430-78d342f83f4f): created successfully Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1f016f-fcc5-4434-8781-e55d4074eb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Flow 'volume_create_manager' (5071998f-33f4-48fb-9084-996dfc0faba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-67b9e645-119e-47ce-b879-aade185e5eb2 tempest-AttachVolumeShelveTestJSON-1117709190 None] Created volume successfully. Sep 23 00:16:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-bb618091-f726-4655-9fe3-90565668b333 req-43975392-32b4-466a-9b0a-d943bcc55f31 tempest-ServerActionsTestOtherA-774435999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-a0654b83-5657-4511-b577-17e56379f28b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2f37260-f344-4dcb-8e44-b7f3b767b5a7', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:16:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-bb618091-f726-4655-9fe3-90565668b333 req-43975392-32b4-466a-9b0a-d943bcc55f31 tempest-ServerActionsTestOtherA-774435999 None] attachment_update completed successfully. Sep 23 00:16:14 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.339s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:14 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2aae24fa-d6e0-4294-8b20-cd550332e595 tempest-GroupSnapshotsTest-1254787139 None] Delete group completed successfully. Sep 23 00:16:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Creating offline snapshot 663ff5a7-566b-4fae-9121-7d35347dae66 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[08daec4e-7691-4ae7-99da-faa5670a1fbf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:15 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:15 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:15 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.556s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-01f69bc7-cad9-4dfd-a13a-4add59bfa29f tempest-GroupSnapshotsTest-1254787139 None] Group tempest-GroupSnapshotsTest-Group-1927642893: creating Sep 23 00:16:15 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 1G Sep 23 00:16:15 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-01f69bc7-cad9-4dfd-a13a-4add59bfa29f tempest-GroupSnapshotsTest-1254787139 None] Group tempest-GroupSnapshotsTest-Group-1927642893: created successfully Sep 23 00:16:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-01f69bc7-cad9-4dfd-a13a-4add59bfa29f tempest-GroupSnapshotsTest-1254787139 None] Create group completed successfully. Sep 23 00:16:16 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 1G" returned: 0 in 1.053s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:16 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 Sep 23 00:16:16 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:17 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66" returned: 0 in 0.849s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:17 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 is being set with open permissions: ugo+rw Sep 23 00:16:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:17 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 Sep 23 00:16:17 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:18 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66" returned: 0 in 0.695s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.377s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fb874ee4-6b11-49c2-8382-574a64e7cd57 tempest-SnapshotsActionsTest-466896839 None] Create snapshot completed successfully Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (95e0d9f9-9e20-41e2-82ed-322af8429a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22ac4e3-bdd1-4966-8c08-29b052464f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22ac4e3-bdd1-4966-8c08-29b052464f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1363885134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97e083d3-ecd8-47af-9e6a-e4e3f0177341,host='devstack@QuobyteHD#QuobyteHD',id=80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:18Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3),volume_type_id=2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb72a21-c623-4855-ac82-55f860bd6a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb72a21-c623-4855-ac82-55f860bd6a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9019ec9b-f834-4c25-97bb-94843b7bdeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9019ec9b-f834-4c25-97bb-94843b7bdeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5', 'volume_name': 'volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e44edd-587a-4315-8726-1e7acd89bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e44edd-587a-4315-8726-1e7acd89bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0017e803-c452-4a7a-99c1-f4a91a92fea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Volume 80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5', 'volume_size': 1} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97e083d3-ecd8-47af-9e6a-e4e3f0177341,created_at=2026-09-22T22:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1363885134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97e083d3-ecd8-47af-9e6a-e4e3f0177341,host='devstack@QuobyteHD#QuobyteHD',id=80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:18Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3),volume_type_id=2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Creating volume 80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:18 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:16:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:18 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 1073741824 Sep 23 00:16:18 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-663ff5a7-566b-4fae-9121-7d35347dae66-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-663ff5a7-566b-4fae-9121-7d35347dae66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-663ff5a7-566b-4fae-9121-7d35347dae66" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-663ff5a7-566b-4fae-9121-7d35347dae66" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Deleting offline snapshot 663ff5a7-566b-4fae-9121-7d35347dae66 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] snapshot_file for this snap is: volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a9def-564d-4554-b744-14d63d6e3833]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:19 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 1073741824" returned: 0 in 1.183s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:19 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 Sep 23 00:16:19 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:19 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 Sep 23 00:16:19 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:20 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" returned: 0 in 0.311s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0017e803-c452-4a7a-99c1-f4a91a92fea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa043660-3dc2-4f08-a103-66dc8fc59796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Volume volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 (80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5): created successfully Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa043660-3dc2-4f08-a103-66dc8fc59796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (95e0d9f9-9e20-41e2-82ed-322af8429a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1308b455-b0d4-43b1-a846-9da95b6fcee1 tempest-GroupSnapshotsTest-1254787139 None] Created volume successfully. Sep 23 00:16:20 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66" returned: 0 in 0.680s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799a960-1318-4192-815f-17c9ca2c4b53]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:20 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.624s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 Sep 23 00:16:21 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66" returned: 0 in 0.715s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66 Sep 23 00:16:21 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (e4cff8ef-6aed-4e28-98b4-082630d38244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7396998c-1f75-4556-8240-9da5fa09a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.663ff5a7-566b-4fae-9121-7d35347dae66" returned: 0 in 0.541s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-663ff5a7-566b-4fae-9121-7d35347dae66" released by "_delete_snapshot" :: held 2.771s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" released by "delete_snapshot" :: held 2.816s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7396998c-1f75-4556-8240-9da5fa09a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245952135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97e083d3-ecd8-47af-9e6a-e4e3f0177341,host='devstack@QuobyteHD#QuobyteHD',id=063b7fbb-f661-45c5-86b3-4b039693c2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:22Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3),volume_type_id=2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9d83e1-f15c-458a-87c5-6feb90dc75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9d83e1-f15c-458a-87c5-6feb90dc75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648be7e1-2fe3-4ebb-99ac-759ce16ed6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648be7e1-2fe3-4ebb-99ac-759ce16ed6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063b7fbb-f661-45c5-86b3-4b039693c2b7', 'volume_name': 'volume-063b7fbb-f661-45c5-86b3-4b039693c2b7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6359b0ee-889e-42e4-a662-c01c2dd4273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6359b0ee-889e-42e4-a662-c01c2dd4273f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939affe4-2e7b-4135-95a3-41d8d005a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:22 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Volume 063b7fbb-f661-45c5-86b3-4b039693c2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063b7fbb-f661-45c5-86b3-4b039693c2b7', 'volume_size': 1} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97e083d3-ecd8-47af-9e6a-e4e3f0177341,created_at=2026-09-22T22:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245952135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97e083d3-ecd8-47af-9e6a-e4e3f0177341,host='devstack@QuobyteHD#QuobyteHD',id=063b7fbb-f661-45c5-86b3-4b039693c2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:22Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3),volume_type_id=2ad7b881-9b9a-4ee3-afea-74faa7ce1ed3)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Creating volume 063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:22 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 1073741824 Sep 23 00:16:22 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Created reservations ['56e5fe79-3eab-47d7-8760-1c443d20a6f7', '85b4c156-db2e-40f4-88d4-8691c28367a0', '45a52d6f-8f3b-42ee-83a8-e71d16f7a35a', '6cccfc27-e9ef-4681-9470-fb06f22c86d6', 'a288d800-4d72-48c4-9b44-075c4d9ce6dc'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:23 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Delete snapshot completed successfully. Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea82f51f-6d71-4ef3-aa13-c1cf9eec09ec tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-663ff5a7-566b-4fae-9121-7d35347dae66-delete_snapshot" released by "delete_snapshot" :: held 3.432s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:23 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 1073741824" returned: 0 in 0.734s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 Sep 23 00:16:23 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7" returned: 0 in 0.415s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939affe4-2e7b-4135-95a3-41d8d005a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063b7fbb-f661-45c5-86b3-4b039693c2b7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11372ce5-7ae7-489f-bfcd-54112abf4c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:23 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Volume volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 (063b7fbb-f661-45c5-86b3-4b039693c2b7): created successfully Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11372ce5-7ae7-489f-bfcd-54112abf4c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (e4cff8ef-6aed-4e28-98b4-082630d38244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:23 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d75f214f-c677-4903-8680-928df905232b tempest-GroupSnapshotsTest-1254787139 None] Created volume successfully. Sep 23 00:16:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Creating offline snapshot ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:24 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[015be17e-8f2e-4909-a315-2e5420aacb7c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:24 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c1b90f99-e36c-4498-a95a-0ace9db4924a tempest-GroupSnapshotsTest-1254787139 None] Update group completed successfully. Sep 23 00:16:25 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.541s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:25 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 1G Sep 23 00:16:25 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 1G" returned: 0 in 0.735s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 Sep 23 00:16:26 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" returned: 0 in 0.502s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:26 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 is being set with open permissions: ugo+rw Sep 23 00:16:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 Sep 23 00:16:26 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5495d04b-8f83-4c30-a770-d16c56b3ed14 tempest-GroupSnapshotsTest-1254787139 None] Update group completed successfully. Sep 23 00:16:26 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-89047157-535a-4815-a828-ba4847262ae8 tempest-SnapshotsActionsTest-466896839 None] Create snapshot completed successfully Sep 23 00:16:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b7f703ad-7c11-4574-b059-e83b0542730b tempest-GroupSnapshotsTest-1254787139 None] Update group completed successfully. Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Deleting offline snapshot ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] snapshot_file for this snap is: volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae774ccf-f88d-458d-9cbe-44114e248d1f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 Sep 23 00:16:28 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" returned: 0 in 0.405s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd94e908-5a05-4e54-b586-557e6272611f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:28 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:29 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e878d252-a447-4e16-a01e-5b725af3fe52 tempest-GroupSnapshotsTest-1254787139 None] Update group completed successfully. Sep 23 00:16:29 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.578s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:29 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 Sep 23 00:16:29 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:29 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" returned: 0 in 0.517s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:29 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4 Sep 23 00:16:29 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:30 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" returned: 0 in 0.310s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4" released by "_delete_snapshot" :: held 1.966s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" released by "delete_snapshot" :: held 1.994s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Created reservations ['c53d149f-045f-41ea-a241-a32e92b4dfe3', '3d577fc1-233a-4ead-bd84-b81479cee9e0', 'aad3dc91-a346-4a25-a67f-e12d80eb55c0', '4b914305-593c-4bee-aa4c-87cd752fa14d', 'dae4163c-68b5-4f8f-b53d-e6dffcfd9783'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Delete snapshot completed successfully. Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7de33c33-7919-4220-bf4d-0bae36b1fcd9 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-ebdff8ad-7d02-41eb-9aa8-2c886a6a24e4-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-3c5af0b3-fe64-4a94-b3f3-7534844e5516 req-e8b3c627-3507-4e05-a496-f4e37af0e87e tempest-AttachVolumeShelveTestJSON-1117709190 None] No connector for attachment ba8b8441-0b97-4e2f-97b8-1ee20d9c21b4; skipping storage backend terminate_connection call. {{(pid=87292) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-3c5af0b3-fe64-4a94-b3f3-7534844e5516 req-e8b3c627-3507-4e05-a496-f4e37af0e87e tempest-AttachVolumeShelveTestJSON-1117709190 None] Deleting attachment ba8b8441-0b97-4e2f-97b8-1ee20d9c21b4. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] GroupSnapshot b51180a3-2ef8-4b99-bb69-f7ebf8374deb: creating. Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Group snapshot b51180a3-2ef8-4b99-bb69-f7ebf8374deb: creating. {{(pid=87292) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Creating offline snapshot 9004c743-7c7d-4c5f-b3bf-3be760c28da0 of volume 80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:31 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d7aace-e29c-4fad-b9cf-8cae5709acc8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 Sep 23 00:16:31 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" returned: 0 in 0.783s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 1G Sep 23 00:16:31 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:32 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 1G" returned: 0 in 0.722s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:32 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 Sep 23 00:16:32 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0" returned: 0 in 0.442s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 Sep 23 00:16:33 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:33 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0" returned: 0 in 0.475s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info Sep 23 00:16:33 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:33 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info" returned: 0 in 0.368s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:33 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info Sep 23 00:16:33 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.info" returned: 0 in 0.339s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.278s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Creating offline snapshot fabd5df7-30f1-4ab5-b840-51bbc016490e of volume 063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2ac72-9f0a-40b8-b528-88ce34bea523]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 Sep 23 00:16:34 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7" returned: 0 in 0.617s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e 1G Sep 23 00:16:34 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e 1G" returned: 0 in 0.569s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e Sep 23 00:16:35 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e Sep 23 00:16:35 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:36 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e" returned: 0 in 0.340s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info Sep 23 00:16:36 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:36 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info" returned: 0 in 0.348s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info Sep 23 00:16:36 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.info" returned: 0 in 0.440s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.925s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Creating offline snapshot 1179ae00-aa29-41d9-b292-8662e6d92aec of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6855bf6-8ded-4bb1-a5a8-796f5ed9ad7c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7587adc8-5335-4c17-b366-3624b3464ac7 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot b51180a3-2ef8-4b99-bb69-f7ebf8374deb: created successfully Sep 23 00:16:37 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:37 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.515s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:37 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec 1G Sep 23 00:16:37 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot b51180a3-2ef8-4b99-bb69-f7ebf8374deb: deleting Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot b51180a3-2ef8-4b99-bb69-f7ebf8374deb: deleting {{(pid=87292) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-9004c743-7c7d-4c5f-b3bf-3be760c28da0" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-9004c743-7c7d-4c5f-b3bf-3be760c28da0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Deleting offline snapshot 9004c743-7c7d-4c5f-b3bf-3be760c28da0 of volume 80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] snapshot_file for this snap is: volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625c67d-ae0e-430c-8b31-c67fe643a6b3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 Sep 23 00:16:38 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec 1G" returned: 0 in 0.690s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec Sep 23 00:16:38 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0" returned: 0 in 0.607s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb554f89-04d4-4541-8a3c-e5c5552b0761]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 Sep 23 00:16:38 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec" returned: 0 in 0.441s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:38 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec is being set with open permissions: ugo+rw Sep 23 00:16:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec Sep 23 00:16:38 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec" returned: 0 in 0.272s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" returned: 0 in 0.451s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 Sep 23 00:16:39 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fab3b7a9-7958-42f9-a5e1-ccfec19d63bf tempest-SnapshotsActionsTest-466896839 None] Create snapshot completed successfully Sep 23 00:16:39 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0" returned: 0 in 0.484s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0 Sep 23 00:16:39 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-1179ae00-aa29-41d9-b292-8662e6d92aec-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-1179ae00-aa29-41d9-b292-8662e6d92aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-1179ae00-aa29-41d9-b292-8662e6d92aec" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-1179ae00-aa29-41d9-b292-8662e6d92aec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Deleting offline snapshot 1179ae00-aa29-41d9-b292-8662e6d92aec of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] snapshot_file for this snap is: volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e434c2f-cc49-4c52-b8d4-3a1b2ff1533a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:40 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5.9004c743-7c7d-4c5f-b3bf-3be760c28da0" returned: 0 in 0.442s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec Sep 23 00:16:40 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-9004c743-7c7d-4c5f-b3bf-3be760c28da0" released by "_delete_snapshot" :: held 2.187s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" released by "delete_snapshot" :: held 2.227s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-063b7fbb-f661-45c5-86b3-4b039693c2b7" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-063b7fbb-f661-45c5-86b3-4b039693c2b7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-fabd5df7-30f1-4ab5-b840-51bbc016490e" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-fabd5df7-30f1-4ab5-b840-51bbc016490e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Deleting offline snapshot fabd5df7-30f1-4ab5-b840-51bbc016490e of volume 063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] snapshot_file for this snap is: volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[036bfe5a-591c-4b58-bef4-a98208ea60e6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:40 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e Sep 23 00:16:40 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec" returned: 0 in 0.608s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de99a95a-5f2d-41d1-b239-1e363d78be6f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:40 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:40 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e" returned: 0 in 0.508s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-063b7fbb-f661-45c5-86b3-4b039693c2b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8707dd6-9af3-450c-825f-5104083272cd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:41 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 Sep 23 00:16:41 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:41 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.560s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:41 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec Sep 23 00:16:41 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:41 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7" returned: 0 in 0.666s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:41 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e Sep 23 00:16:41 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:42 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec" returned: 0 in 0.894s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:42 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec Sep 23 00:16:42 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:42 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e" returned: 0 in 0.915s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:42 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e Sep 23 00:16:42 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:42 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.1179ae00-aa29-41d9-b292-8662e6d92aec" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-1179ae00-aa29-41d9-b292-8662e6d92aec" released by "_delete_snapshot" :: held 2.797s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" released by "delete_snapshot" :: held 2.842s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:42 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Created reservations ['0a5f45d9-0656-4c9b-bdd7-9478cdbf1ebf', '8b93b3a3-7b18-4876-9543-fa4edc3c4923', 'ad9aae4a-ff3d-40f1-99b8-68db8bd9e527', 'd7643073-68c1-4dc5-b2f7-0d079846545f', '0f9dc84b-47cc-4fc2-8306-929d373c4d00'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Delete snapshot completed successfully. Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91cdb3a0-5f87-4c40-a4d5-e82a815377cb tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-1179ae00-aa29-41d9-b292-8662e6d92aec-delete_snapshot" released by "delete_snapshot" :: held 3.232s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:43 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7.fabd5df7-30f1-4ab5-b840-51bbc016490e" returned: 0 in 0.667s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-fabd5df7-30f1-4ab5-b840-51bbc016490e" released by "_delete_snapshot" :: held 2.985s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-063b7fbb-f661-45c5-86b3-4b039693c2b7" released by "delete_snapshot" :: held 3.020s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:43 devstack cinder-volume[87292]: WARNING cinder.quota [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-258524172 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-258524172, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:43 devstack cinder-volume[87292]: WARNING cinder.quota [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-258524172 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-258524172, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['4fac1509-9ee0-40f3-97ef-676da3d69457', 'f029a1ed-f49a-4de4-b316-61e3ada2d57f', 'a1800a9c-299f-4357-a21f-bb43e2c123bd', 'e14eec50-0227-4c67-a1be-ee0dc584f0e5', 'c97710e2-8301-4bf0-a7d3-fa97d18207d3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo_db.api [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 00:16:43 devstack cinder-volume[87292]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 00:16:43 devstack cinder-volume[87292]: FROM reservations Sep 23 00:16:43 devstack cinder-volume[87292]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s, %(uuid_1_5)s) FOR UPDATE] Sep 23 00:16:43 devstack cinder-volume[87292]: [parameters: {'uuid_1_1': '4fac1509-9ee0-40f3-97ef-676da3d69457', 'uuid_1_2': 'f029a1ed-f49a-4de4-b316-61e3ada2d57f', 'uuid_1_3': 'a1800a9c-299f-4357-a21f-bb43e2c123bd', 'uuid_1_4': 'e14eec50-0227-4c67-a1be-ee0dc584f0e5', 'uuid_1_5': 'c97710e2-8301-4bf0-a7d3-fa97d18207d3'}] Sep 23 00:16:43 devstack cinder-volume[87292]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87292) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo_db.api [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87292) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Creating offline snapshot bb48c2d8-e904-4923-b49b-68b5ebe069a7 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be163dc-08f7-4a5b-b941-7fd8115d072f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:44 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:44 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:44 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['4d545e0b-1525-448d-9329-f12e27a1a0f8', '1af04ff4-394b-47e0-ba92-5a312903318a', '42c3638c-8a4d-4ff6-b92a-aac06227d0af', 'ff99f50e-2941-4b2c-bc2b-8a47af195e9a', '27c690f0-da08-4ce0-862d-89987508a438'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:44 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.861s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c3c1448a-4728-46bc-a8fd-9830e371a738 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot b51180a3-2ef8-4b99-bb69-f7ebf8374deb: deleted successfully Sep 23 00:16:44 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 1G Sep 23 00:16:44 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 1G" returned: 0 in 0.628s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 Sep 23 00:16:45 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7" returned: 0 in 0.391s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:45 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 is being set with open permissions: ugo+rw Sep 23 00:16:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 Sep 23 00:16:45 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:46 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7" returned: 0 in 0.339s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bce9faf0-0863-4773-9901-1c444299c80c tempest-SnapshotsActionsTest-466896839 None] Create snapshot completed successfully Sep 23 00:16:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-063b7fbb-f661-45c5-86b3-4b039693c2b7" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-063b7fbb-f661-45c5-86b3-4b039693c2b7" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7efddd-675f-459d-85b6-0acee36195b0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:46 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 Sep 23 00:16:46 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7" returned: 0 in 0.548s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7 Sep 23 00:16:47 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-bb48c2d8-e904-4923-b49b-68b5ebe069a7-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-bb48c2d8-e904-4923-b49b-68b5ebe069a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Acquiring lock "cinder-quobyte-bb48c2d8-e904-4923-b49b-68b5ebe069a7" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-bb48c2d8-e904-4923-b49b-68b5ebe069a7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Deleting offline snapshot bb48c2d8-e904-4923-b49b-68b5ebe069a7 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] snapshot_file for this snap is: volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdff2da-c731-426d-8675-dc13ce12293e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-063b7fbb-f661-45c5-86b3-4b039693c2b7" returned: 0 in 0.287s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-063b7fbb-f661-45c5-86b3-4b039693c2b7" released by "delete_volume" :: held 0.927s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:47 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 Sep 23 00:16:47 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfaac63-9f8d-489a-a0af-748b7d255a7d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 Sep 23 00:16:47 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[049d8dd0-a33c-48ed-abb0-f7813023de72]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" returned: 0 in 0.468s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:48 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:48 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5 Sep 23 00:16:48 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:48 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:48 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" returned: 0 in 0.379s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:48 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.527s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80df9ff2-7aaf-41bc-9dc2-c07eba4b3bc5" released by "delete_volume" :: held 0.964s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:48 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 Sep 23 00:16:48 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['ac291b98-aa80-4686-bcb8-be3bf4cbfcd3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:48 devstack cinder-volume[87292]: WARNING cinder.quota [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-258524172 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-258524172, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['571319ad-5787-4008-b9c5-3e99d7e45ae1', '92517695-2581-45f1-99f7-528da6a2f1d5', 'b312e178-9419-47fd-9c86-fd66cb27142c', 'db752872-d24e-43b3-981c-cefad02da410', 'eb7b863e-8019-4814-ad15-bbb3c4c2cc93'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['02df65bb-6f63-4fb1-9312-dbdbb0b40c80', '7fa32b67-432e-4977-afee-01418850fa88', 'f8e0f6aa-7c52-4caf-b7af-637483a9770a', '714aab47-2a03-4414-98c0-af916d71e5de', 'ac6159ed-fadf-414d-9d51-e1bbfbdea412'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:48 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7" returned: 0 in 0.512s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:48 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7 Sep 23 00:16:48 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:48 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:16:48 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.bb48c2d8-e904-4923-b49b-68b5ebe069a7" returned: 0 in 0.445s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-bb48c2d8-e904-4923-b49b-68b5ebe069a7" released by "_delete_snapshot" :: held 2.121s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" released by "delete_snapshot" :: held 2.161s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:49 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.508s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1f689c1a-4c3d-4c20-8d9f-cbf6f271cf7d tempest-GroupSnapshotsTest-1254787139 None] Delete group completed successfully. Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Created reservations ['e81be997-344e-4716-a40d-87e7d69c1a44', '19cb8cc0-8f8a-45d9-9977-dc5c04732b14', 'a668ae03-71b7-4fc2-9205-94af5cebac31', 'd5ac53e3-fbae-4245-afd5-e667d145dcfb', 'd6dafac6-1bd9-422f-bd83-809891a96155'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d4d130cd-9401-4472-b10e-a8d5f0db0792 tempest-GroupSnapshotsTest-1254787139 None] Group tempest-GroupSnapshotsTest-Group-1683831302: creating Sep 23 00:16:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d4d130cd-9401-4472-b10e-a8d5f0db0792 tempest-GroupSnapshotsTest-1254787139 None] Group tempest-GroupSnapshotsTest-Group-1683831302: created successfully Sep 23 00:16:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Delete snapshot completed successfully. Sep 23 00:16:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-64f183a1-703c-4e3c-a6d1-c18a7e9b3e40 tempest-SnapshotsActionsTest-305300218 None] Lock "cinder-bb48c2d8-e904-4923-b49b-68b5ebe069a7-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d4d130cd-9401-4472-b10e-a8d5f0db0792 tempest-GroupSnapshotsTest-1254787139 None] Create group completed successfully. Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "cinder-5012f146-6ad5-48ba-a05f-714780fae791-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-5012f146-6ad5-48ba-a05f-714780fae791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "cinder-quobyte-5012f146-6ad5-48ba-a05f-714780fae791" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-quobyte-5012f146-6ad5-48ba-a05f-714780fae791" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Deleting offline snapshot 5012f146-6ad5-48ba-a05f-714780fae791 of volume 3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] snapshot_file for this snap is: volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aead0a-8c6c-4649-a812-5420c0cff581]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:51 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (44b1cfe6-c504-42b0-b562-67a3cba3bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b7bde-3cd2-4ecb-ae02-f16e73032b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b7bde-3cd2-4ecb-ae02-f16e73032b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779920019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2d9c65b-3417-48da-a04a-546e3a518a8e,host='devstack@QuobyteHD#QuobyteHD',id=80d8fc68-ab1c-4ed1-803b-55b22a104075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:52Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e379808-8abd-4a83-9029-154138f3e676),volume_type_id=6e379808-8abd-4a83-9029-154138f3e676)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c88a374-b618-47d8-bb48-4adb00e741d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c88a374-b618-47d8-bb48-4adb00e741d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc63c17-ee34-4c61-88e3-43d485cbdecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc63c17-ee34-4c61-88e3-43d485cbdecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d8fc68-ab1c-4ed1-803b-55b22a104075', 'volume_name': 'volume-80d8fc68-ab1c-4ed1-803b-55b22a104075', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5a076f-c29a-4142-b56d-8a7ef34352f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5a076f-c29a-4142-b56d-8a7ef34352f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6415a507-8d2a-41b1-9160-dd3b359d807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Volume 80d8fc68-ab1c-4ed1-803b-55b22a104075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d8fc68-ab1c-4ed1-803b-55b22a104075', 'volume_size': 1} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2d9c65b-3417-48da-a04a-546e3a518a8e,created_at=2026-09-22T22:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779920019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2d9c65b-3417-48da-a04a-546e3a518a8e,host='devstack@QuobyteHD#QuobyteHD',id=80d8fc68-ab1c-4ed1-803b-55b22a104075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23042dca4d004bfd94ded472441590b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:52Z,use_quota=True,user_id='db7af2e084924109addb5a1ac377a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e379808-8abd-4a83-9029-154138f3e676),volume_type_id=6e379808-8abd-4a83-9029-154138f3e676)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Creating volume 80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:51 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 1073741824 Sep 23 00:16:51 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.554s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f2cc6-570c-4b44-901f-dd36a0190d31]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a Sep 23 00:16:52 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 1073741824" returned: 0 in 0.499s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 Sep 23 00:16:52 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a" returned: 0 in 0.488s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:52 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075" returned: 0 in 0.333s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6415a507-8d2a-41b1-9160-dd3b359d807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d8fc68-ab1c-4ed1-803b-55b22a104075', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b10943d-0e06-4273-8326-1dbe657ff584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:52 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Volume volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 (80d8fc68-ab1c-4ed1-803b-55b22a104075): created successfully Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b10943d-0e06-4273-8326-1dbe657ff584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Flow 'volume_create_manager' (44b1cfe6-c504-42b0-b562-67a3cba3bf71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8e7c662e-ceb0-4c3c-b764-ff43868a7238 tempest-GroupSnapshotsTest-1254787139 None] Created volume successfully. Sep 23 00:16:52 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791 Sep 23 00:16:52 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a.5012f146-6ad5-48ba-a05f-714780fae791" returned: 0 in 0.304s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-quobyte-5012f146-6ad5-48ba-a05f-714780fae791" released by "_delete_snapshot" :: held 2.011s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" released by "delete_snapshot" :: held 2.048s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] GroupSnapshot 2e9012cf-5037-4fa5-8fb1-68b4ec982bbd: creating. Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Group snapshot 2e9012cf-5037-4fa5-8fb1-68b4ec982bbd: creating. {{(pid=87292) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Creating offline snapshot 4491e6bf-8e1f-4799-aebb-6029d487ef48 of volume 80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7bf3df-a5aa-4434-a3b5-b2c9aa6fb913]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Created reservations ['d2ffcec6-243f-4d60-b801-57545c8c881c', '2f1d97af-1a65-4b2f-aad4-9cf667688993', '03d4c227-a3dd-4478-8a7b-baf6f6d7215e', 'b113f436-a653-4851-b938-1336945910c9', 'f24e2102-a308-4aaa-b19a-bb76104404e1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:53 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 Sep 23 00:16:53 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Delete snapshot completed successfully. Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-692bda80-623c-4c53-9176-9171ac3b4428 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-5012f146-6ad5-48ba-a05f-714780fae791-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:53 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075" returned: 0 in 0.399s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 1G Sep 23 00:16:53 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 1G" returned: 0 in 0.489s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 Sep 23 00:16:54 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "cinder-3ad1a15e-31fc-4894-8569-f7b7683ed89a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-3ad1a15e-31fc-4894-8569-f7b7683ed89a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcf9d7d-0e9e-4779-b370-799694e6635a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:54 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:16:54 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 Sep 23 00:16:54 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a Sep 23 00:16:54 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 8 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info Sep 23 00:16:55 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a" returned: 0 in 0.529s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a Sep 23 00:16:55 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info" returned: 0 in 0.329s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info Sep 23 00:16:55 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3ad1a15e-31fc-4894-8569-f7b7683ed89a" returned: 0 in 0.296s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-quobyte-3ad1a15e-31fc-4894-8569-f7b7683ed89a" released by "delete_volume" :: held 0.911s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Created reservations ['efaf39fd-2b39-4a61-bb01-f6d2ed8081a2', 'e7e73014-251f-4fd5-ab32-b2ccaf89bcc5', '4c15ed5c-d29c-4191-9a3a-1eab075d70ac', '145b1e68-10d0-43ee-b91d-92eb0e81eafd', '90f8a7b8-7a08-4281-9f67-d43cf18aa70e'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:55 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.info" returned: 0 in 0.345s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:16:55 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c3232835-59f9-4818-a2ff-adf18287e0c3 tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 2e9012cf-5037-4fa5-8fb1-68b4ec982bbd: created successfully Sep 23 00:16:56 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.328s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Deleted volume successfully. Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-365f0e7c-2775-4ad2-b06b-f31f4fc32876 tempest-SnapshotsActionsTest-466896839 None] Lock "cinder-3ad1a15e-31fc-4894-8569-f7b7683ed89a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 2e9012cf-5037-4fa5-8fb1-68b4ec982bbd: deleting Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 2e9012cf-5037-4fa5-8fb1-68b4ec982bbd: deleting {{(pid=87292) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-80d8fc68-ab1c-4ed1-803b-55b22a104075" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80d8fc68-ab1c-4ed1-803b-55b22a104075" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-4491e6bf-8e1f-4799-aebb-6029d487ef48" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-4491e6bf-8e1f-4799-aebb-6029d487ef48" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Deleting offline snapshot 4491e6bf-8e1f-4799-aebb-6029d487ef48 of volume 80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] snapshot_file for this snap is: volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c6830-d3c7-4146-acb4-9512a7e9823d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:57 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 Sep 23 00:16:57 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:57 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48" returned: 0 in 0.577s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d8fc68-ab1c-4ed1-803b-55b22a104075(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[88df66ed-fb48-495a-b825-bd500ba511fe]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:57 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 Sep 23 00:16:57 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075" returned: 0 in 0.685s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 Sep 23 00:16:58 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48" returned: 0 in 0.523s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48 Sep 23 00:16:58 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075.4491e6bf-8e1f-4799-aebb-6029d487ef48" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-4491e6bf-8e1f-4799-aebb-6029d487ef48" released by "_delete_snapshot" :: held 2.341s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80d8fc68-ab1c-4ed1-803b-55b22a104075" released by "delete_snapshot" :: held 2.385s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:59 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-b357b2d5-403d-4a71-99be-6fa221f2ea3e req-238e4d92-744e-42e2-9782-a0e9eb81dccd tempest-ServerActionsTestOtherA-774435999 None] Terminate volume connection completed successfully. Sep 23 00:16:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-b357b2d5-403d-4a71-99be-6fa221f2ea3e req-238e4d92-744e-42e2-9782-a0e9eb81dccd tempest-ServerActionsTestOtherA-774435999 None] Deleting attachment a2f37260-f344-4dcb-8e44-b7f3b767b5a7. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:59 devstack cinder-volume[87292]: WARNING cinder.quota [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-653503894 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-653503894, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:59 devstack cinder-volume[87292]: WARNING cinder.quota [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-653503894 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-653503894, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:59 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['d4008e4d-f9f2-491b-aaf5-9582f252e025', 'f42625a2-9775-4c3a-8e2e-e94789668154', '0e9bd904-2c52-4f6b-a8be-a00d2b777ab0', '9515052f-e4de-4319-9b22-4a3965573c17', '8e2adea5-9c5b-4158-bd3c-ec0898d65b91'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:59 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c480fcfb-b82f-4128-8343-9a9bc9eaf30d tempest-GroupSnapshotsTest-1254787139 None] group_snapshot 2e9012cf-5037-4fa5-8fb1-68b4ec982bbd: deleted successfully Sep 23 00:17:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "cinder-quobyte-80d8fc68-ab1c-4ed1-803b-55b22a104075" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80d8fc68-ab1c-4ed1-803b-55b22a104075" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:01 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ff549-4800-4eb4-86a1-32131345ddbe]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:01 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 Sep 23 00:17:01 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:01 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075" returned: 0 in 0.475s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:01 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075 Sep 23 00:17:01 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:02 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-80d8fc68-ab1c-4ed1-803b-55b22a104075" returned: 0 in 0.450s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Lock "cinder-quobyte-80d8fc68-ab1c-4ed1-803b-55b22a104075" released by "delete_volume" :: held 1.072s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['9ee64053-9ad9-43d6-b154-73908e71b78f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:02 devstack cinder-volume[87292]: WARNING cinder.quota [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-653503894 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-653503894, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Created reservations ['b3a1f1aa-bf98-4619-ab0f-3b608873de2b', '7c48d38d-1bb8-410b-bdbd-b33afa2fe12d', 'de4da059-3694-4289-8a52-4b4d7823f1f5', '442264df-7407-4712-a823-b2bf40757c5e', '5b13ec96-3398-461c-a229-888a3fe47f93'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:02 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:17:02 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:03 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.340s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:03 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-abb032c4-5346-4746-bcf9-fcdaa809fb5f tempest-GroupSnapshotsTest-1254787139 None] Delete group completed successfully. Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=161,cinder:INSERT=41,cinder:SELECT=172,cinder:DELETE=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=183,cinder:UPDATE=167,cinder:INSERT=48,cinder:DELETE=7 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Flow 'volume_create_manager' (a7f3d052-e5f9-427a-af53-9afa03e4fee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96afb52-487e-40d8-8017-ca19be0f0d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96afb52-487e-40d8-8017-ca19be0f0d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1765586089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db8a179-5106-482c-8670-df3c59a21191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c335e69951f43c2bc1b86270b71ec7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:09Z,use_quota=True,user_id='db09e1c7a25e4b6c8dd29e55a4dd37f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd75078b-5444-4d52-b386-4af49443c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd75078b-5444-4d52-b386-4af49443c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a9624d-6670-470a-b483-989f1644e96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a9624d-6670-470a-b483-989f1644e96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8db8a179-5106-482c-8670-df3c59a21191', 'volume_name': 'volume-8db8a179-5106-482c-8670-df3c59a21191', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a765ce-bc78-4f07-a9d1-49a8d99157d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a765ce-bc78-4f07-a9d1-49a8d99157d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6211793c-ef90-45b0-9cd4-b6c7d2346fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Volume 8db8a179-5106-482c-8670-df3c59a21191: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8db8a179-5106-482c-8670-df3c59a21191', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Trying to clone 8db8a179-5106-482c-8670-df3c59a21191 from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:17:11 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50aad18-5f3e-4766-bd4d-cd6e2af17d75]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:12 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD Sep 23 00:17:12 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:12 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:12 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 is fetched for user db09e1c7a25e4b6c8dd29e55a4dd37f4. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:17:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a4f717-f81e-4ff5-967b-df1c5e5d8dd1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:12 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD Sep 23 00:17:12 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1765586089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db8a179-5106-482c-8670-df3c59a21191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c335e69951f43c2bc1b86270b71ec7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:09Z,use_quota=True,user_id='db09e1c7a25e4b6c8dd29e55a4dd37f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Creating volume 8db8a179-5106-482c-8670-df3c59a21191 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:13 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 1073741824 Sep 23 00:17:13 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 1073741824" returned: 0 in 0.816s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:14 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 Sep 23 00:17:14 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:14 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191" returned: 0 in 0.371s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Attempting download of 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume 8db8a179-5106-482c-8670-df3c59a21191. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f029b5-461c-49f7-b542-cd3d2f78caaa]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:14 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0 Sep 23 00:17:14 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0" returned: 0 in 0.533s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0 Sep 23 00:17:15 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0" returned: 1 in 0.496s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_9z4ymol0' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d176ed-b39b-497a-b2aa-6b9384e5bba1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD Sep 23 00:17:15 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Acquiring lock "cinder-b3513900-68ba-41e0-b430-78d342f83f4f-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "cinder-b3513900-68ba-41e0-b430-78d342f83f4f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Acquiring lock "cinder-quobyte-b3513900-68ba-41e0-b430-78d342f83f4f" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "cinder-quobyte-b3513900-68ba-41e0-b430-78d342f83f4f" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc76ee-efe6-45f0-b761-8639e11cacfd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD" returned: 0 in 0.648s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] 6eb882ce-4d61-40f4-9438-6ccb8337d906 was qcow2, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 Sep 23 00:17:16 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f Sep 23 00:17:16 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f" returned: 0 in 0.691s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f Sep 23 00:17:16 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3513900-68ba-41e0-b430-78d342f83f4f" returned: 0 in 0.435s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "cinder-quobyte-b3513900-68ba-41e0-b430-78d342f83f4f" released by "delete_volume" :: held 1.207s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Created reservations ['2f2153c2-ebf3-498b-807f-28d67eac1905', 'e40b3c91-327a-4c3d-b00a-9ff1f81a6498', '53aab61c-8411-4572-88da-9df36d90572b', '1730b414-34d8-4baf-8906-553d9c9cef95', '5540cadf-a139-450f-bbf1-e720e3a3f63d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:17 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:17:17 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.394s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Deleted volume successfully. Sep 23 00:17:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dfbdad91-69a9-4c5e-b8b7-49f87092ab76 tempest-AttachVolumeShelveTestJSON-1117709190 None] Lock "cinder-b3513900-68ba-41e0-b430-78d342f83f4f-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191" returned: 0 in 3.041s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_akt_2eg7devstack@QuobyteHD, size 112.00 MB, duration 3.04 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:17:19 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Converted 112.00 MB image at 36.82 MB/s Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 1G Sep 23 00:17:19 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Flow 'volume_create_manager' (58f08aa2-4b2e-49fe-85ee-26f9d843696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376381a4-bd05-41cf-ae8f-92f8171ad083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376381a4-bd05-41cf-ae8f-92f8171ad083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2006880983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3867b09-87f7-47e5-baee-b23d897fe671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3894dd145eea4be098f10a746fb3c3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:19Z,use_quota=True,user_id='92c119fe0d79420ea5df30ac97999e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3379048e-810e-4f03-a00e-205fd2186f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3379048e-810e-4f03-a00e-205fd2186f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b314e484-40da-4f90-a3f6-9bfe948202ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b314e484-40da-4f90-a3f6-9bfe948202ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3867b09-87f7-47e5-baee-b23d897fe671', 'volume_name': 'volume-a3867b09-87f7-47e5-baee-b23d897fe671', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfc1e18-2d5b-48a4-8bc0-9c1aedfe549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfc1e18-2d5b-48a4-8bc0-9c1aedfe549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b705b2d-f9b8-420d-9798-e0a208374d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Volume a3867b09-87f7-47e5-baee-b23d897fe671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3867b09-87f7-47e5-baee-b23d897fe671', 'volume_size': 1} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2006880983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3867b09-87f7-47e5-baee-b23d897fe671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3894dd145eea4be098f10a746fb3c3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:19Z,use_quota=True,user_id='92c119fe0d79420ea5df30ac97999e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Creating volume a3867b09-87f7-47e5-baee-b23d897fe671 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:19 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 1073741824 Sep 23 00:17:19 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 1G" returned: 0 in 0.475s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Downloaded image 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume 8db8a179-5106-482c-8670-df3c59a21191 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 for user db09e1c7a25e4b6c8dd29e55a4dd37f4 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Marking volume 8db8a179-5106-482c-8670-df3c59a21191 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Copying metadata from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 to 8db8a179-5106-482c-8670-df3c59a21191. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:17:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Creating volume glance metadata for volume 8db8a179-5106-482c-8670-df3c59a21191 backed by image 6eb882ce-4d61-40f4-9438-6ccb8337d906 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6211793c-ef90-45b0-9cd4-b6c7d2346fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db8a179-5106-482c-8670-df3c59a21191', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0439898b-22ee-409b-9742-30558c529cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:20 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Volume volume-8db8a179-5106-482c-8670-df3c59a21191 (8db8a179-5106-482c-8670-df3c59a21191): created successfully Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0439898b-22ee-409b-9742-30558c529cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Flow 'volume_create_manager' (a7f3d052-e5f9-427a-af53-9afa03e4fee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b153f715-dd56-4fa0-9297-bfe0f3827221 tempest-ServerActionsTestOtherA-774435999 None] Created volume successfully. Sep 23 00:17:20 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 1073741824" returned: 0 in 0.757s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 Sep 23 00:17:20 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b705b2d-f9b8-420d-9798-e0a208374d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3867b09-87f7-47e5-baee-b23d897fe671', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0014d3-280c-4a52-a566-e84eefdb9f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:20 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Volume volume-a3867b09-87f7-47e5-baee-b23d897fe671 (a3867b09-87f7-47e5-baee-b23d897fe671): created successfully Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0014d3-280c-4a52-a566-e84eefdb9f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:20 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Flow 'volume_create_manager' (58f08aa2-4b2e-49fe-85ee-26f9d843696b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-99873c28-ee1b-4710-8b96-98363d40d581 tempest-VolumesServicesTestJSON-903225436 None] Created volume successfully. Sep 23 00:17:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Acquiring lock "cinder-a3867b09-87f7-47e5-baee-b23d897fe671-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Lock "cinder-a3867b09-87f7-47e5-baee-b23d897fe671-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Acquiring lock "cinder-quobyte-a3867b09-87f7-47e5-baee-b23d897fe671" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Lock "cinder-quobyte-a3867b09-87f7-47e5-baee-b23d897fe671" acquired by "delete_volume" :: waited 0.045s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954aa58-e043-4898-a310-d2d0ace81b5d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 Sep 23 00:17:22 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671" returned: 0 in 0.732s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671 Sep 23 00:17:22 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3867b09-87f7-47e5-baee-b23d897fe671" returned: 0 in 0.396s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Lock "cinder-quobyte-a3867b09-87f7-47e5-baee-b23d897fe671" released by "delete_volume" :: held 1.216s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Created reservations ['3cac7420-054f-4a13-a00b-6cd8a1ae0a02', 'd1e96660-f562-4dd9-8811-baee61a8747f', '81abb4ff-8de4-4196-81e6-231a88dce84e', '2a51326a-6c2e-4e15-8880-99ebd6421f11', 'e33b511e-5442-4375-8664-0848048a1c3c'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:23 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:17:23 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.507s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:23 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Deleted volume successfully. Sep 23 00:17:24 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7d2d9f40-1ab2-4052-825d-f5737c10e9da tempest-VolumesServicesTestJSON-903225436 None] Lock "cinder-a3867b09-87f7-47e5-baee-b23d897fe671-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-a33f1d58-8b41-47be-8f3a-2b3ccde2222f req-23a22513-d164-4aeb-a4b5-1b11f8e5838e tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-a33f1d58-8b41-47be-8f3a-2b3ccde2222f req-23a22513-d164-4aeb-a4b5-1b11f8e5838e tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-a33f1d58-8b41-47be-8f3a-2b3ccde2222f req-23a22513-d164-4aeb-a4b5-1b11f8e5838e tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-a33f1d58-8b41-47be-8f3a-2b3ccde2222f req-23a22513-d164-4aeb-a4b5-1b11f8e5838e tempest-ServerActionsTestOtherA-774435999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-8db8a179-5106-482c-8670-df3c59a21191', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cba0441-18fd-4cbc-b011-56cfbe8fe599', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-a33f1d58-8b41-47be-8f3a-2b3ccde2222f req-23a22513-d164-4aeb-a4b5-1b11f8e5838e tempest-ServerActionsTestOtherA-774435999 None] attachment_update completed successfully. Sep 23 00:17:35 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=37,cinder:INSERT=11,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:35 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=22,cinder:UPDATE=27,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d32fdf12-5efd-4bea-ad4c-374976acc412 tempest-GroupsTest-1526265342 None] Group tempest-Group1-1889016216: creating Sep 23 00:17:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d32fdf12-5efd-4bea-ad4c-374976acc412 tempest-GroupsTest-1526265342 None] Group tempest-Group1-1889016216: created successfully Sep 23 00:17:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d32fdf12-5efd-4bea-ad4c-374976acc412 tempest-GroupsTest-1526265342 None] Create group completed successfully. Sep 23 00:17:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-18cc725b-055f-4763-b568-0f1ce5b0e357 tempest-GroupsTest-1526265342 None] Group tempest-Group2-2042508291: creating Sep 23 00:17:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-18cc725b-055f-4763-b568-0f1ce5b0e357 tempest-GroupsTest-1526265342 None] Group tempest-Group2-2042508291: created successfully Sep 23 00:17:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-18cc725b-055f-4763-b568-0f1ce5b0e357 tempest-GroupsTest-1526265342 None] Create group completed successfully. Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Flow 'volume_create_manager' (c961a2f1-b480-4f97-b273-7b13f4f4eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a7365a-e452-4a6b-8821-a1a4ac705905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a7365a-e452-4a6b-8821-a1a4ac705905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1679332731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=630b37fa-046c-4387-b546-391f68f4cbd5,host='devstack@QuobyteHD#QuobyteHD',id=4b88e969-4539-45be-9855-90e0c6196036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9676f7277cf54413af073e27300d97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:40Z,use_quota=True,user_id='17197b21f07f4ddd991f782bebdc7a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbf649bc-3078-4099-b38e-18f1a48bfd1e),volume_type_id=cbf649bc-3078-4099-b38e-18f1a48bfd1e)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942b444e-1afe-4342-85ec-8a8376e58861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942b444e-1afe-4342-85ec-8a8376e58861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b6503f-07ff-4583-991f-db0b20961cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b6503f-07ff-4583-991f-db0b20961cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b88e969-4539-45be-9855-90e0c6196036', 'volume_name': 'volume-4b88e969-4539-45be-9855-90e0c6196036', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fc9e23-2125-4e2f-9222-e10dec9b3c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fc9e23-2125-4e2f-9222-e10dec9b3c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d6c285-b4a1-4d06-a39d-8d40b23a4f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Volume 4b88e969-4539-45be-9855-90e0c6196036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b88e969-4539-45be-9855-90e0c6196036', 'volume_size': 1} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=630b37fa-046c-4387-b546-391f68f4cbd5,created_at=2026-09-22T22:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1679332731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=630b37fa-046c-4387-b546-391f68f4cbd5,host='devstack@QuobyteHD#QuobyteHD',id=4b88e969-4539-45be-9855-90e0c6196036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9676f7277cf54413af073e27300d97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:40Z,use_quota=True,user_id='17197b21f07f4ddd991f782bebdc7a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbf649bc-3078-4099-b38e-18f1a48bfd1e),volume_type_id=cbf649bc-3078-4099-b38e-18f1a48bfd1e)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Creating volume 4b88e969-4539-45be-9855-90e0c6196036 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:40 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:17:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:40 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 1073741824 Sep 23 00:17:40 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:41 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 1073741824" returned: 0 in 0.856s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:41 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 Sep 23 00:17:41 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:41 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036" returned: 0 in 0.609s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d6c285-b4a1-4d06-a39d-8d40b23a4f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b88e969-4539-45be-9855-90e0c6196036', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf431c44-de76-4c5c-8707-5c0335df4e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Volume volume-4b88e969-4539-45be-9855-90e0c6196036 (4b88e969-4539-45be-9855-90e0c6196036): created successfully Sep 23 00:17:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf431c44-de76-4c5c-8707-5c0335df4e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Flow 'volume_create_manager' (c961a2f1-b480-4f97-b273-7b13f4f4eef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e8889458-e24a-4762-822e-5051b9271693 tempest-GroupsTest-1526265342 None] Created volume successfully. Sep 23 00:17:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Acquiring lock "cinder-quobyte-4b88e969-4539-45be-9855-90e0c6196036" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Lock "cinder-quobyte-4b88e969-4539-45be-9855-90e0c6196036" acquired by "delete_volume" :: waited 0.055s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:44 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110180f-5fc6-4ced-ada6-d5a7718ae0e1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:44 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 Sep 23 00:17:44 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:44 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036" returned: 0 in 0.876s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:45 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036 Sep 23 00:17:45 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:45 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4b88e969-4539-45be-9855-90e0c6196036" returned: 0 in 0.581s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Lock "cinder-quobyte-4b88e969-4539-45be-9855-90e0c6196036" released by "delete_volume" :: held 1.568s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:45 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Created reservations ['61521390-058a-4875-a226-3c9d33a7535c'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:45 devstack cinder-volume[87292]: WARNING cinder.quota [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-214223006 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-214223006, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:17:45 devstack cinder-volume[87292]: WARNING cinder.quota [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-214223006 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-214223006, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:17:45 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Created reservations ['80bb92a4-e3e5-418d-b1b9-15e588654954', '044d8c9b-6a5a-4e9a-b319-3be2ec0c1df5', 'fac9d2c3-dbb9-40d3-98c9-f8dd062c4e66', '779eb90c-304d-4e74-b5ac-176b6fe8eebf', '4ef9adce-3172-447c-9906-b5bd32469590'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:46 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:17:46 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:46 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.547s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fb16111d-71dd-499d-9be6-c011963bd1b7 tempest-GroupsTest-1526265342 None] Delete group completed successfully. Sep 23 00:17:46 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Created reservations ['6f2a9a99-405d-426c-8be9-3f7b50f83a30'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:47 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:17:47 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:47 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.717s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:47 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-99d679a4-d4f9-44d4-8b95-8f8fa94040e9 tempest-GroupsTest-1526265342 None] Delete group completed successfully. Sep 23 00:17:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61a8763b-c18d-4b6b-827a-d17fc00f807d tempest-GroupsTest-1526265342 None] Group tempest-GroupsTest-Group-2026418052: creating Sep 23 00:17:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61a8763b-c18d-4b6b-827a-d17fc00f807d tempest-GroupsTest-1526265342 None] Group tempest-GroupsTest-Group-2026418052: created successfully Sep 23 00:17:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61a8763b-c18d-4b6b-827a-d17fc00f807d tempest-GroupsTest-1526265342 None] Create group completed successfully. Sep 23 00:17:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-892d0fc1-1d0b-496a-91cc-f1f397439363 tempest-ServerActionsTestOtherA-774435999 None] Terminate volume connection completed successfully. Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-892d0fc1-1d0b-496a-91cc-f1f397439363 tempest-ServerActionsTestOtherA-774435999 None] Deleting attachment 7cba0441-18fd-4cbc-b011-56cfbe8fe599. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Flow 'volume_create_manager' (94f0e332-e019-4fb9-bb73-d19bcf3a54f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0306362d-79fc-40b3-9c84-d66b72474c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0306362d-79fc-40b3-9c84-d66b72474c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001763845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28129c1b-e7b2-4ba1-aa90-b4833dbe5968,host='devstack@QuobyteHD#QuobyteHD',id=1f39a932-3298-43c1-8a75-c5e450c9cc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9676f7277cf54413af073e27300d97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:53Z,use_quota=True,user_id='17197b21f07f4ddd991f782bebdc7a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f8cd38f-9478-4c1a-93b4-93f1d75effcd),volume_type_id=5f8cd38f-9478-4c1a-93b4-93f1d75effcd)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fdaa13-f673-4fa7-ad34-81f2b359f65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fdaa13-f673-4fa7-ad34-81f2b359f65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0174deb-ffdb-4a29-a89f-8b30093ab26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0174deb-ffdb-4a29-a89f-8b30093ab26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f39a932-3298-43c1-8a75-c5e450c9cc33', 'volume_name': 'volume-1f39a932-3298-43c1-8a75-c5e450c9cc33', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee8cd32-4597-43a9-8bd5-fc63e3f52c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee8cd32-4597-43a9-8bd5-fc63e3f52c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0435347c-1f78-4fe2-b20e-b5bdc3bdd90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Volume 1f39a932-3298-43c1-8a75-c5e450c9cc33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f39a932-3298-43c1-8a75-c5e450c9cc33', 'volume_size': 1} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28129c1b-e7b2-4ba1-aa90-b4833dbe5968,created_at=2026-09-22T22:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001763845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28129c1b-e7b2-4ba1-aa90-b4833dbe5968,host='devstack@QuobyteHD#QuobyteHD',id=1f39a932-3298-43c1-8a75-c5e450c9cc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9676f7277cf54413af073e27300d97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:53Z,use_quota=True,user_id='17197b21f07f4ddd991f782bebdc7a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f8cd38f-9478-4c1a-93b4-93f1d75effcd),volume_type_id=5f8cd38f-9478-4c1a-93b4-93f1d75effcd)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Creating volume 1f39a932-3298-43c1-8a75-c5e450c9cc33 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:53 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:17:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:53 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 1073741824 Sep 23 00:17:53 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 1073741824" returned: 0 in 0.895s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 Sep 23 00:17:54 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33" returned: 0 in 0.451s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:17:54 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0435347c-1f78-4fe2-b20e-b5bdc3bdd90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f39a932-3298-43c1-8a75-c5e450c9cc33', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731b0fe4-a9c4-4aa2-a5c7-1774282c30cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:54 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Volume volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 (1f39a932-3298-43c1-8a75-c5e450c9cc33): created successfully Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731b0fe4-a9c4-4aa2-a5c7-1774282c30cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Flow 'volume_create_manager' (94f0e332-e019-4fb9-bb73-d19bcf3a54f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:55 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cf6ad412-67ff-49ae-a42f-8aef7d0af83f tempest-GroupsTest-1526265342 None] Created volume successfully. Sep 23 00:17:55 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:17:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-f93cc08e-1e35-4158-b357-ffe8202f9ad6 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-f93cc08e-1e35-4158-b357-ffe8202f9ad6 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-f93cc08e-1e35-4158-b357-ffe8202f9ad6 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-f93cc08e-1e35-4158-b357-ffe8202f9ad6 tempest-ServerActionsTestOtherA-774435999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-8db8a179-5106-482c-8670-df3c59a21191', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8219f0a2-6916-4fe0-8f92-dc26b3e60fdd', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-35b28a8d-9e3c-4d08-976a-294ddd568785 req-f93cc08e-1e35-4158-b357-ffe8202f9ad6 tempest-ServerActionsTestOtherA-774435999 None] attachment_update completed successfully. Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Flow 'volume_create_manager' (dfef2146-5a4d-45cc-9aca-e1f66479afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e273ee85-57bf-4d9f-ab2b-00582c538bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e273ee85-57bf-4d9f-ab2b-00582c538bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1372979938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57296570-b088-41f9-8ff4-2feeceffaa36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226873340b24f9193d76acbea447c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:56Z,use_quota=True,user_id='2f1dbfa86c194e9cbbfdd8608ff72128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372c0edf-2bcd-4e43-9b7b-be11228dc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372c0edf-2bcd-4e43-9b7b-be11228dc23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62224a1b-d8e2-46be-b4ba-0f942728f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62224a1b-d8e2-46be-b4ba-0f942728f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57296570-b088-41f9-8ff4-2feeceffaa36', 'volume_name': 'volume-57296570-b088-41f9-8ff4-2feeceffaa36', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b242af-49e7-4be1-ad75-76879ec68df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b242af-49e7-4be1-ad75-76879ec68df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6a790c-3753-4adb-b5ae-913559e69bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:56 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Volume 57296570-b088-41f9-8ff4-2feeceffaa36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57296570-b088-41f9-8ff4-2feeceffaa36', 'volume_size': 1} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1372979938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57296570-b088-41f9-8ff4-2feeceffaa36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226873340b24f9193d76acbea447c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:56Z,use_quota=True,user_id='2f1dbfa86c194e9cbbfdd8608ff72128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Creating volume 57296570-b088-41f9-8ff4-2feeceffaa36 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:56 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:17:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:56 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 1073741824 Sep 23 00:17:56 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Flow 'volume_create_manager' (9900763a-7097-47e3-b149-b0c3ee6f076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171128b0-be11-46cd-9164-bfa8e682a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171128b0-be11-46cd-9164-bfa8e682a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854407963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28129c1b-e7b2-4ba1-aa90-b4833dbe5968,host='devstack@QuobyteHD#QuobyteHD',id=fbec4110-1082-4aa7-8328-ecf167b4ebd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9676f7277cf54413af073e27300d97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:57Z,use_quota=True,user_id='17197b21f07f4ddd991f782bebdc7a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f8cd38f-9478-4c1a-93b4-93f1d75effcd),volume_type_id=5f8cd38f-9478-4c1a-93b4-93f1d75effcd)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefaae8a-8ccb-4694-b6e0-d447b2f2ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefaae8a-8ccb-4694-b6e0-d447b2f2ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b0f01-c219-493c-b7c5-a18767fb15fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b0f01-c219-493c-b7c5-a18767fb15fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbec4110-1082-4aa7-8328-ecf167b4ebd9', 'volume_name': 'volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e3021-50e5-4bcb-b1dc-f9fe193f3152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e3021-50e5-4bcb-b1dc-f9fe193f3152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca9888-f18f-4537-b50c-819ddc52378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Volume fbec4110-1082-4aa7-8328-ecf167b4ebd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9', 'volume_size': 1} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:57 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 1073741824" returned: 0 in 0.903s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:57 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 Sep 23 00:17:57 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:58 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36" returned: 0 in 0.604s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28129c1b-e7b2-4ba1-aa90-b4833dbe5968,created_at=2026-09-22T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854407963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28129c1b-e7b2-4ba1-aa90-b4833dbe5968,host='devstack@QuobyteHD#QuobyteHD',id=fbec4110-1082-4aa7-8328-ecf167b4ebd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9676f7277cf54413af073e27300d97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:57Z,use_quota=True,user_id='17197b21f07f4ddd991f782bebdc7a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f8cd38f-9478-4c1a-93b4-93f1d75effcd),volume_type_id=5f8cd38f-9478-4c1a-93b4-93f1d75effcd)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Creating volume fbec4110-1082-4aa7-8328-ecf167b4ebd9 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:58 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6a790c-3753-4adb-b5ae-913559e69bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57296570-b088-41f9-8ff4-2feeceffaa36', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:58 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 1073741824 Sep 23 00:17:58 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3fe37c-e830-4735-a7bd-3102ed044c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:58 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Volume volume-57296570-b088-41f9-8ff4-2feeceffaa36 (57296570-b088-41f9-8ff4-2feeceffaa36): created successfully Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3fe37c-e830-4735-a7bd-3102ed044c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Flow 'volume_create_manager' (dfef2146-5a4d-45cc-9aca-e1f66479afde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7105c9c5-eeba-4cca-9184-8ba122d58f1f tempest-VolumesListAdminTestJSON-655446133 None] Created volume successfully. Sep 23 00:17:59 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 1073741824" returned: 0 in 0.908s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:59 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 Sep 23 00:17:59 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:59 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9" returned: 0 in 0.360s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca9888-f18f-4537-b50c-819ddc52378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b832d7e1-adc6-44ef-b6d0-7d0d912c9ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:59 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Volume volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 (fbec4110-1082-4aa7-8328-ecf167b4ebd9): created successfully Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b832d7e1-adc6-44ef-b6d0-7d0d912c9ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Flow 'volume_create_manager' (9900763a-7097-47e3-b149-b0c3ee6f076f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:59 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-32fba954-ebff-454c-a045-ca7ce555784d tempest-GroupsTest-1526265342 None] Created volume successfully. Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Flow 'volume_create_manager' (4bf16708-399f-4f2f-9642-4f14cc946c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7de419-911d-47a1-bcf4-858638769930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7de419-911d-47a1-bcf4-858638769930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1258602519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226873340b24f9193d76acbea447c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:00Z,use_quota=True,user_id='2f1dbfa86c194e9cbbfdd8608ff72128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603a60bd-a2b8-4b28-8019-62816dcecdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603a60bd-a2b8-4b28-8019-62816dcecdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439a60cb-4d41-4819-b606-9c38e30a864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439a60cb-4d41-4819-b606-9c38e30a864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a', 'volume_name': 'volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d84a71d-339d-49a2-9923-90cba00f0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d84a71d-339d-49a2-9923-90cba00f0b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b25c18-22c4-408a-8e25-970c669f2df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:00 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Volume eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a', 'volume_size': 1} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1258602519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226873340b24f9193d76acbea447c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:00Z,use_quota=True,user_id='2f1dbfa86c194e9cbbfdd8608ff72128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Creating volume eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:00 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:00 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a 1073741824 Sep 23 00:18:00 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:01 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a 1073741824" returned: 0 in 1.019s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-60e50c9a-10bc-4339-99d4-491f3f7efba5 tempest-GroupsTest-1526265342 None] Update group completed successfully. Sep 23 00:18:01 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a Sep 23 00:18:01 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:01 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a" returned: 0 in 0.473s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b25c18-22c4-408a-8e25-970c669f2df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380fbc62-714e-48ff-93ed-08b54142fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Volume volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a (eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a): created successfully Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380fbc62-714e-48ff-93ed-08b54142fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Flow 'volume_create_manager' (4bf16708-399f-4f2f-9642-4f14cc946c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-59e7b5e2-703e-4f4b-ac1c-2c5148c73f20 tempest-VolumesListAdminTestJSON-655446133 None] Created volume successfully. Sep 23 00:18:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3098bcce-1efd-4f39-893d-a4e9e78bbd41 tempest-GroupsTest-1526265342 None] Update group completed successfully. Sep 23 00:18:03 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Flow 'volume_create_manager' (c2318fe3-348f-461a-a41d-4b285a6feab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d8266b-45de-4b1c-8db9-10d9982f59e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d8266b-45de-4b1c-8db9-10d9982f59e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1640823970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29e7acd-ee18-47e0-8c91-e71ae304878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226873340b24f9193d76acbea447c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:04Z,use_quota=True,user_id='2f1dbfa86c194e9cbbfdd8608ff72128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec5323-2a0c-40dd-bd60-b2ca6861919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec5323-2a0c-40dd-bd60-b2ca6861919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8123c227-9580-43ad-a98b-2c47cdde134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8123c227-9580-43ad-a98b-2c47cdde134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29e7acd-ee18-47e0-8c91-e71ae304878d', 'volume_name': 'volume-c29e7acd-ee18-47e0-8c91-e71ae304878d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3f6e0-0f64-43d0-addd-f3b7f8cb679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3f6e0-0f64-43d0-addd-f3b7f8cb679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64d8ee4-d419-4bc4-a5e9-838342b207d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Volume c29e7acd-ee18-47e0-8c91-e71ae304878d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29e7acd-ee18-47e0-8c91-e71ae304878d', 'volume_size': 1} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1640823970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29e7acd-ee18-47e0-8c91-e71ae304878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1226873340b24f9193d76acbea447c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:04Z,use_quota=True,user_id='2f1dbfa86c194e9cbbfdd8608ff72128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Creating volume c29e7acd-ee18-47e0-8c91-e71ae304878d {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:04 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:04 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d 1073741824 Sep 23 00:18:04 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:05 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d 1073741824" returned: 0 in 1.274s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:05 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d Sep 23 00:18:05 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Acquiring lock "cinder-quobyte-1f39a932-3298-43c1-8a75-c5e450c9cc33" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Lock "cinder-quobyte-1f39a932-3298-43c1-8a75-c5e450c9cc33" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc690e38-9971-4d79-8dab-a679cd198123]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:06 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d" returned: 0 in 0.810s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64d8ee4-d419-4bc4-a5e9-838342b207d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29e7acd-ee18-47e0-8c91-e71ae304878d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c7460b-d565-414a-9599-8d61a8db7656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Volume volume-c29e7acd-ee18-47e0-8c91-e71ae304878d (c29e7acd-ee18-47e0-8c91-e71ae304878d): created successfully Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c7460b-d565-414a-9599-8d61a8db7656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Flow 'volume_create_manager' (c2318fe3-348f-461a-a41d-4b285a6feab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:06 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 Sep 23 00:18:06 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8da394fd-fedb-4c58-8485-e2587a49a6ad tempest-VolumesListAdminTestJSON-655446133 None] Created volume successfully. Sep 23 00:18:07 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33" returned: 0 in 1.151s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:07 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33 Sep 23 00:18:07 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:08 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1f39a932-3298-43c1-8a75-c5e450c9cc33" returned: 0 in 0.596s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Lock "cinder-quobyte-1f39a932-3298-43c1-8a75-c5e450c9cc33" released by "delete_volume" :: held 1.839s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Acquiring lock "cinder-quobyte-fbec4110-1082-4aa7-8328-ecf167b4ebd9" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Lock "cinder-quobyte-fbec4110-1082-4aa7-8328-ecf167b4ebd9" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[559960b1-b5a2-47b9-95aa-fa583c72e88d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:08 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 Sep 23 00:18:08 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:09 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9" returned: 0 in 0.880s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:09 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9 Sep 23 00:18:09 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Flow 'volume_create_manager' (ece02fa7-ebfb-4611-b115-cfb2082119b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09dff25-0b2d-40e9-915c-926f7601f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09dff25-0b2d-40e9-915c-926f7601f367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b337b3-7841-4bce-97ec-047c770e1dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='355d048ee3fb43ba8bd30773c1071564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:09Z,use_quota=True,user_id='c49b0470970940dcab98dc624a62f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9248e509-c5bc-43d4-9e0a-f68e40582967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9248e509-c5bc-43d4-9e0a-f68e40582967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3feaf00b-3196-4a72-915a-ff7dbf1727a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3feaf00b-3196-4a72-915a-ff7dbf1727a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b337b3-7841-4bce-97ec-047c770e1dbc', 'volume_name': 'volume-69b337b3-7841-4bce-97ec-047c770e1dbc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d1a7e5-c7c4-4525-90ef-5b0df1f98391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d1a7e5-c7c4-4525-90ef-5b0df1f98391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92277d3-eebc-44e0-a4d6-95e74f7f8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:09 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Volume 69b337b3-7841-4bce-97ec-047c770e1dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b337b3-7841-4bce-97ec-047c770e1dbc', 'volume_size': 1} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b337b3-7841-4bce-97ec-047c770e1dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='355d048ee3fb43ba8bd30773c1071564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:09Z,use_quota=True,user_id='c49b0470970940dcab98dc624a62f637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Creating volume 69b337b3-7841-4bce-97ec-047c770e1dbc {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:09 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:09 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc 1073741824 Sep 23 00:18:09 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:09 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fbec4110-1082-4aa7-8328-ecf167b4ebd9" returned: 0 in 0.528s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Lock "cinder-quobyte-fbec4110-1082-4aa7-8328-ecf167b4ebd9" released by "delete_volume" :: held 1.482s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Created reservations ['975a7983-5736-4dd0-8556-61dd7d2cd7b0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:09 devstack cinder-volume[87292]: WARNING cinder.quota [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-448070126 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-448070126, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:18:09 devstack cinder-volume[87292]: WARNING cinder.quota [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-448070126 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-448070126, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:18:09 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Created reservations ['cd2b2a1e-e1a3-44b4-85b3-bfffdaeebb0c', '9a1c1042-8dd9-4e5d-9411-9094c0690ffe', 'f87ebdcc-7d8d-4aca-bd8e-e1ae557846a4', '4c4e64f5-4f4c-4808-b792-1cce1acb9337', 'c2507c9c-fe89-4808-9857-ec8c435cf062'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Created reservations ['3caa2c04-e517-4af6-bbe2-1ed9cd640faa', '07b537a2-6bd4-4ec8-8003-188922eea64e', '7e355268-63c6-4cca-bcb1-1f05561ee8c8', '19e35f94-ea95-4c53-a4f5-8c3cd311f3ae', 'c332e129-a794-4c10-ae32-b12e04de9dae'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:10 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc 1073741824" returned: 0 in 0.757s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:10 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc Sep 23 00:18:10 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:10 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:10 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:10 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc" returned: 0 in 0.685s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92277d3-eebc-44e0-a4d6-95e74f7f8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b337b3-7841-4bce-97ec-047c770e1dbc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f29197a-b44e-4479-836f-0a2bdd2289eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:11 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Volume volume-69b337b3-7841-4bce-97ec-047c770e1dbc (69b337b3-7841-4bce-97ec-047c770e1dbc): created successfully Sep 23 00:18:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f29197a-b44e-4479-836f-0a2bdd2289eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:11 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Flow 'volume_create_manager' (ece02fa7-ebfb-4611-b115-cfb2082119b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.723s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:11 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d01d7dbb-745a-489b-bf4e-86a16ddb784a tempest-GroupsTest-1526265342 None] Delete group completed successfully. Sep 23 00:18:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c73d9845-812b-4cc5-9e5e-851c0be78141 tempest-VolumesListAdminTestJSON-1618649960 None] Created volume successfully. Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Acquiring lock "cinder-69b337b3-7841-4bce-97ec-047c770e1dbc-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "cinder-69b337b3-7841-4bce-97ec-047c770e1dbc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Acquiring lock "cinder-quobyte-69b337b3-7841-4bce-97ec-047c770e1dbc" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "cinder-quobyte-69b337b3-7841-4bce-97ec-047c770e1dbc" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ebd31d-4bf9-42fe-a15f-91b59cfca6f9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "cinder-c29e7acd-ee18-47e0-8c91-e71ae304878d-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-c29e7acd-ee18-47e0-8c91-e71ae304878d-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "cinder-quobyte-c29e7acd-ee18-47e0-8c91-e71ae304878d" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-quobyte-c29e7acd-ee18-47e0-8c91-e71ae304878d" acquired by "delete_volume" :: waited 0.087s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:14 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc Sep 23 00:18:14 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c3cc6-709b-40a2-82d9-7cfafab9f06a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:14 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d Sep 23 00:18:14 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:15 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc" returned: 0 in 1.639s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:15 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc Sep 23 00:18:15 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:15 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d" returned: 0 in 1.098s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:15 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d Sep 23 00:18:15 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:15 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-69b337b3-7841-4bce-97ec-047c770e1dbc" returned: 0 in 0.616s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "cinder-quobyte-69b337b3-7841-4bce-97ec-047c770e1dbc" released by "delete_volume" :: held 2.388s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Created reservations ['7adf1be6-029c-4e90-9bfe-5d21b4bb4a55', '079fd366-dcf7-44b7-a701-f79f8b1f2279', '5204a431-9f38-4c84-80e1-af8cf354439a', '9cb4e123-4046-4a4b-bbd9-348e04b8601c', '6a99d72e-c33d-4d21-8e85-3cbdc85b0d25'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:16 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c29e7acd-ee18-47e0-8c91-e71ae304878d" returned: 0 in 0.882s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-quobyte-c29e7acd-ee18-47e0-8c91-e71ae304878d" released by "delete_volume" :: held 2.204s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:16 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:16 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Created reservations ['9ce3c598-83a9-48bc-9db8-ce3a16d01935', '21302c90-3b2e-44ef-b876-b5bd344c7a14', 'c87c881f-e7db-4b44-8957-2ae5e59f4e09', '739ec5bc-a820-4a28-a662-a1a3cd7ca102', '82b2f7ad-ccb1-45a2-a523-26e5e8a0f40a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:16 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:16 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:17 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.673s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Deleted volume successfully. Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-186ced47-54ec-4b1e-9aba-21b9dcccd2d2 tempest-VolumesListAdminTestJSON-1618649960 None] Lock "cinder-69b337b3-7841-4bce-97ec-047c770e1dbc-delete_volume" released by "delete_volume" :: held 3.794s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:17 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.678s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Deleted volume successfully. Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41ca3c95-3964-4c97-afd3-bc8a353e7cda tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-c29e7acd-ee18-47e0-8c91-e71ae304878d-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "cinder-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "cinder-quobyte-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-quobyte-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a" acquired by "delete_volume" :: waited 0.058s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:18 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefadcdd-558a-485c-b7c4-767c5d0c230b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:18 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a Sep 23 00:18:18 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:19 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a" returned: 0 in 1.009s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:19 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a Sep 23 00:18:19 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:19 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a" returned: 0 in 0.569s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-quobyte-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a" released by "delete_volume" :: held 1.703s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Created reservations ['cedbeec6-5bad-4f98-8eeb-f5cedb37cffa', '23a1f9f1-0dc0-4129-ad70-ecae5836293d', '66c858ef-dbe0-45d6-a5a7-3be1ea3a5f0e', 'ba79fdcd-667b-42da-8daa-f3a87c77b583', 'e7aaca96-3b9a-4c43-a62d-a2386d96e849'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:20 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:20 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "cinder-57296570-b088-41f9-8ff4-2feeceffaa36-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-57296570-b088-41f9-8ff4-2feeceffaa36-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "cinder-quobyte-57296570-b088-41f9-8ff4-2feeceffaa36" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:20 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.481s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Deleted volume successfully. Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-quobyte-57296570-b088-41f9-8ff4-2feeceffaa36" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e90afa-548c-4111-8886-9a1064326cd2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-93f17168-49d2-4507-8228-c2082c505a00 tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-eaa9b24c-50bf-4f8f-8451-e4bd8c5dc17a-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:21 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 Sep 23 00:18:21 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:21 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36" returned: 0 in 0.566s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:21 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36 Sep 23 00:18:21 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:21 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-57296570-b088-41f9-8ff4-2feeceffaa36" returned: 0 in 0.374s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-quobyte-57296570-b088-41f9-8ff4-2feeceffaa36" released by "delete_volume" :: held 1.053s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:21 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Created reservations ['e9fa614b-bc30-4312-bbd7-6f2f0cfabf4e', '405264a6-0f3f-44d2-936a-8c4712230b93', '872f8c91-c193-474b-86f9-ef97e2a2faf9', '1a495643-792b-4087-8da8-96c5289abe5d', '680d67b8-91b2-4353-8bdd-a839b4fcac11'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:22 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:22 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:22 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:22 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Deleted volume successfully. Sep 23 00:18:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fcf7f19-58d5-4150-96c1-e1c0ace855fd tempest-VolumesListAdminTestJSON-655446133 None] Lock "cinder-57296570-b088-41f9-8ff4-2feeceffaa36-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-53ed9018-1aa4-48ec-a09d-1b6dfd3b127b tempest-GroupsV320Test-1099022445 None] Group tempest-GroupsV320Test-Group-147264750: creating Sep 23 00:18:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-53ed9018-1aa4-48ec-a09d-1b6dfd3b127b tempest-GroupsV320Test-1099022445 None] Group tempest-GroupsV320Test-Group-147264750: created successfully Sep 23 00:18:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-53ed9018-1aa4-48ec-a09d-1b6dfd3b127b tempest-GroupsV320Test-1099022445 None] Create group completed successfully. Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Created reservations ['0ac2df1f-3604-4c8f-bbca-5de2ebbea0f8'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:27 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.319s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f039250d-b6d3-4a5b-862b-e1644ffda634 tempest-GroupsV320Test-1099022445 None] Delete group completed successfully. Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Flow 'volume_create_manager' (75bebd4f-c830-4d9b-a12b-31adb768a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0312a8ba-e754-4734-9715-3a1756d20458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0312a8ba-e754-4734-9715-3a1756d20458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-698223141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac68393c-a1d2-46b8-8cab-b59177838e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d794776514b34baea1348b0663f972a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:30Z,use_quota=True,user_id='172619b8649d449fb15641319bce2f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bca26c8-d00b-4336-838b-1e83de827437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bca26c8-d00b-4336-838b-1e83de827437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa391da9-9cfc-414b-a532-189ece011803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa391da9-9cfc-414b-a532-189ece011803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac68393c-a1d2-46b8-8cab-b59177838e39', 'volume_name': 'volume-ac68393c-a1d2-46b8-8cab-b59177838e39', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b2bfe5-b1a1-4bd0-bd6e-ce1c85996041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b2bfe5-b1a1-4bd0-bd6e-ce1c85996041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87267c58-ba11-4265-82ca-16aeb233eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:30 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Volume ac68393c-a1d2-46b8-8cab-b59177838e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac68393c-a1d2-46b8-8cab-b59177838e39', 'volume_size': 1} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-698223141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac68393c-a1d2-46b8-8cab-b59177838e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d794776514b34baea1348b0663f972a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:30Z,use_quota=True,user_id='172619b8649d449fb15641319bce2f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Creating volume ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:30 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:30 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 1073741824 Sep 23 00:18:30 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:31 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 1073741824" returned: 0 in 0.715s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:31 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 Sep 23 00:18:31 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:31 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39" returned: 0 in 0.328s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87267c58-ba11-4265-82ca-16aeb233eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac68393c-a1d2-46b8-8cab-b59177838e39', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f2b90-b7e1-4d50-a1c7-a9e8d834a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Volume volume-ac68393c-a1d2-46b8-8cab-b59177838e39 (ac68393c-a1d2-46b8-8cab-b59177838e39): created successfully Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f2b90-b7e1-4d50-a1c7-a9e8d834a45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Flow 'volume_create_manager' (75bebd4f-c830-4d9b-a12b-31adb768a034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-71313472-6768-4e47-8381-c5ce1f2beae0 tempest-SnapshotMetadataTestJSON-2063723337 None] Created volume successfully. Sep 23 00:18:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Creating offline snapshot 1ec30fe6-1793-4b0b-a270-71a03e7bdac5 of volume ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc0382-6e0c-40ab-b536-f29416e2045f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:33 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 Sep 23 00:18:33 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:33 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39" returned: 0 in 0.557s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:33 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 1G Sep 23 00:18:33 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:34 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 1G" returned: 0 in 0.559s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac68393c-a1d2-46b8-8cab-b59177838e39 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:34 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac68393c-a1d2-46b8-8cab-b59177838e39 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 Sep 23 00:18:34 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:34 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac68393c-a1d2-46b8-8cab-b59177838e39 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5" returned: 0 in 0.424s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:34 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 is being set with open permissions: ugo+rw Sep 23 00:18:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:34 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 Sep 23 00:18:34 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:34 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5" returned: 0 in 0.368s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:34 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info Sep 23 00:18:34 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:35 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info" returned: 0 in 0.370s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:35 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info is being set with open permissions: ugo+rw Sep 23 00:18:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:35 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info Sep 23 00:18:35 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:35 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.info" returned: 0 in 0.313s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-15357798-f99d-4c92-b291-2c681dfcfcf7 tempest-SnapshotMetadataTestJSON-2063723337 None] Create snapshot completed successfully Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "cinder-1ec30fe6-1793-4b0b-a270-71a03e7bdac5-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-1ec30fe6-1793-4b0b-a270-71a03e7bdac5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "cinder-quobyte-ac68393c-a1d2-46b8-8cab-b59177838e39" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-quobyte-ac68393c-a1d2-46b8-8cab-b59177838e39" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "cinder-quobyte-1ec30fe6-1793-4b0b-a270-71a03e7bdac5" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-quobyte-1ec30fe6-1793-4b0b-a270-71a03e7bdac5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Deleting offline snapshot 1ec30fe6-1793-4b0b-a270-71a03e7bdac5 of volume ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] snapshot_file for this snap is: volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd0aee-63a0-4f68-ac8d-7a9455136028]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:37 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 Sep 23 00:18:37 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:38 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5" returned: 0 in 0.687s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac68393c-a1d2-46b8-8cab-b59177838e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9637f7ed-45bc-4d17-9c56-a8ff4667b51d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:38 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 Sep 23 00:18:38 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:38 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39" returned: 0 in 0.558s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:38 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 Sep 23 00:18:38 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:39 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5" returned: 0 in 0.560s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:39 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5 Sep 23 00:18:39 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:39 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39.1ec30fe6-1793-4b0b-a270-71a03e7bdac5" returned: 0 in 0.536s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:39 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=92,cinder:UPDATE=110,cinder:INSERT=25,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:39 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=101,cinder:UPDATE=102,cinder:INSERT=23,cinder:DELETE=11 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-quobyte-1ec30fe6-1793-4b0b-a270-71a03e7bdac5" released by "_delete_snapshot" :: held 2.534s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-quobyte-ac68393c-a1d2-46b8-8cab-b59177838e39" released by "delete_snapshot" :: held 2.573s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Created reservations ['b8f25841-7820-4b27-a9d1-32c0656dc562', '702ab333-2408-4b7f-b8f7-70585058386d', '66a28522-b155-409d-a5d2-f5cbc3ad8096', '99fb07a1-410a-4eaa-9fb2-640af695c9bf', 'd73357ca-9ae0-4940-9d8c-7be4b6127d63'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Delete snapshot completed successfully. Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e3d3c42-050c-4125-94fe-0f5162e49935 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-1ec30fe6-1793-4b0b-a270-71a03e7bdac5-delete_snapshot" released by "delete_snapshot" :: held 2.924s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Flow 'volume_create_manager' (1bfc826b-f213-403f-a46f-7c5275e67d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83f8a7e-71d1-49d3-a0f4-1dc874b015c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83f8a7e-71d1-49d3-a0f4-1dc874b015c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2146433456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1f6516-f702-4a22-b098-48dd3f9ae68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c020f27bfd42d4a797e60e2bd94734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:40Z,use_quota=True,user_id='ba69648324d742cd96f26955462f1e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c29d249-e2fc-40fc-9d5b-1e7e82a96498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c29d249-e2fc-40fc-9d5b-1e7e82a96498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc60c75-ffb7-4a22-b8c8-27345deb0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc60c75-ffb7-4a22-b8c8-27345deb0754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1f6516-f702-4a22-b098-48dd3f9ae68d', 'volume_name': 'volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051340ae-3204-4145-b7bd-44a7b431a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051340ae-3204-4145-b7bd-44a7b431a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efee9b-c5bc-42a3-9a90-84d7a3bbf4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Volume fb1f6516-f702-4a22-b098-48dd3f9ae68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d', 'volume_size': 1} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2146433456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1f6516-f702-4a22-b098-48dd3f9ae68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c020f27bfd42d4a797e60e2bd94734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:40Z,use_quota=True,user_id='ba69648324d742cd96f26955462f1e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Creating volume fb1f6516-f702-4a22-b098-48dd3f9ae68d {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:40 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:40 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d 1073741824 Sep 23 00:18:40 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "cinder-ac68393c-a1d2-46b8-8cab-b59177838e39-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-ac68393c-a1d2-46b8-8cab-b59177838e39-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "cinder-quobyte-ac68393c-a1d2-46b8-8cab-b59177838e39" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-quobyte-ac68393c-a1d2-46b8-8cab-b59177838e39" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a2b79-f5e4-436c-bf58-92d57230cdb1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:41 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 Sep 23 00:18:41 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:41 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d 1073741824" returned: 0 in 0.564s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:41 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d Sep 23 00:18:41 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:41 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39" returned: 0 in 0.496s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:41 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39 Sep 23 00:18:41 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:41 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d" returned: 0 in 0.379s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efee9b-c5bc-42a3-9a90-84d7a3bbf4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315e2609-5e03-4706-8254-b0f004774fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:41 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Volume volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d (fb1f6516-f702-4a22-b098-48dd3f9ae68d): created successfully Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315e2609-5e03-4706-8254-b0f004774fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Flow 'volume_create_manager' (1bfc826b-f213-403f-a46f-7c5275e67d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-483b2537-b876-4702-b658-5ed849b6ef4d tempest-AttachVolumeNegativeTest-2066461253 None] Created volume successfully. Sep 23 00:18:41 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ac68393c-a1d2-46b8-8cab-b59177838e39" returned: 0 in 0.367s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-quobyte-ac68393c-a1d2-46b8-8cab-b59177838e39" released by "delete_volume" :: held 0.943s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:41 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Created reservations ['e46d215c-d048-40bf-a885-59a2fb977b91', '145670cb-b66a-46db-86a2-949f69b695c1', 'fb9d2dbc-0ff2-44c3-96db-29a429abd735', '0b456658-ac35-464d-96fb-9dceb4eede80', '46f0ddcc-965d-418b-8830-6a92b1710593'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:42 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:42 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:42 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.266s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Deleted volume successfully. Sep 23 00:18:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e2b01cfa-8933-4b50-babd-9b3730ff3ab8 tempest-SnapshotMetadataTestJSON-2063723337 None] Lock "cinder-ac68393c-a1d2-46b8-8cab-b59177838e39-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-6f15efeb-b78a-4f15-8ed2-f93b75a9e0a6 req-0ab3c114-0d1f-409f-b930-d43dbbbd0385 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-6f15efeb-b78a-4f15-8ed2-f93b75a9e0a6 req-0ab3c114-0d1f-409f-b930-d43dbbbd0385 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-6f15efeb-b78a-4f15-8ed2-f93b75a9e0a6 req-0ab3c114-0d1f-409f-b930-d43dbbbd0385 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-6f15efeb-b78a-4f15-8ed2-f93b75a9e0a6 req-0ab3c114-0d1f-409f-b930-d43dbbbd0385 tempest-AttachVolumeNegativeTest-2066461253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f71a7408-5a16-4c54-a397-713a4d7db4b1', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:18:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-6f15efeb-b78a-4f15-8ed2-f93b75a9e0a6 req-0ab3c114-0d1f-409f-b930-d43dbbbd0385 tempest-AttachVolumeNegativeTest-2066461253 None] attachment_update completed successfully. Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Flow 'volume_create_manager' (875d871e-3bb6-4886-81a2-10761e130c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b0df65-1a85-4fb5-87f0-d4958aa6dc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b0df65-1a85-4fb5-87f0-d4958aa6dc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-150187403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53199859-0129-407b-be53-30adaf1c2524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0155c0b6b0465b838c328262b93c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:47Z,use_quota=True,user_id='1fbde0213fa8411885864eaada91454f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377a66e2-dbef-4c6c-b2c7-b84916634210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377a66e2-dbef-4c6c-b2c7-b84916634210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f313d0f-1c2d-4863-a0a1-94ff45bd9d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f313d0f-1c2d-4863-a0a1-94ff45bd9d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53199859-0129-407b-be53-30adaf1c2524', 'volume_name': 'volume-53199859-0129-407b-be53-30adaf1c2524', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a50207c-ac34-4d70-9b2f-7318ee87f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a50207c-ac34-4d70-9b2f-7318ee87f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da82f97-87a5-496b-b09e-e0657345e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Volume 53199859-0129-407b-be53-30adaf1c2524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53199859-0129-407b-be53-30adaf1c2524', 'volume_size': 1} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-150187403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53199859-0129-407b-be53-30adaf1c2524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0155c0b6b0465b838c328262b93c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:47Z,use_quota=True,user_id='1fbde0213fa8411885864eaada91454f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Creating volume 53199859-0129-407b-be53-30adaf1c2524 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:47 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 1073741824 Sep 23 00:18:47 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 1073741824" returned: 0 in 0.793s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 Sep 23 00:18:48 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524" returned: 0 in 0.441s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da82f97-87a5-496b-b09e-e0657345e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53199859-0129-407b-be53-30adaf1c2524', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41595087-91b5-4204-86cf-6bf97956dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-b72e6f9c-e561-45a2-a4e6-53aa7bbf2e79 tempest-ServerActionsTestOtherA-774435999 None] Terminate volume connection completed successfully. Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-b72e6f9c-e561-45a2-a4e6-53aa7bbf2e79 tempest-ServerActionsTestOtherA-774435999 None] Deleting attachment 8219f0a2-6916-4fe0-8f92-dc26b3e60fdd. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:18:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Volume volume-53199859-0129-407b-be53-30adaf1c2524 (53199859-0129-407b-be53-30adaf1c2524): created successfully Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41595087-91b5-4204-86cf-6bf97956dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Flow 'volume_create_manager' (875d871e-3bb6-4886-81a2-10761e130c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-32c8c299-1884-4274-bcee-83bbba73d416 tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Created volume successfully. Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "cinder-8db8a179-5106-482c-8670-df3c59a21191-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-8db8a179-5106-482c-8670-df3c59a21191-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "cinder-quobyte-8db8a179-5106-482c-8670-df3c59a21191" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-quobyte-8db8a179-5106-482c-8670-df3c59a21191" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825fe39-feec-4b74-9f22-0933ea374772]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 Sep 23 00:18:49 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191" returned: 0 in 0.696s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191 Sep 23 00:18:50 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8db8a179-5106-482c-8670-df3c59a21191" returned: 0 in 0.326s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-quobyte-8db8a179-5106-482c-8670-df3c59a21191" released by "delete_volume" :: held 1.120s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG cinder.quota [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Created reservations ['3a7802be-92f1-4a90-94d3-bb65ed183b93', 'df674661-a96f-45bf-b959-f888152859d2', 'ab81329d-cabf-46ef-9b00-0f00f69326a6', '89037d9d-f87d-4207-a19b-bae6343259ab', '91957fa0-f0c6-4261-9105-6cb3e898390d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:50 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[87292]: DEBUG cinder.manager [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Deleted volume successfully. Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-d613c4ba-53a8-4493-b134-fb686bba62cf req-391460d1-9f05-4916-8f49-a7da406f8e75 tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-8db8a179-5106-482c-8670-df3c59a21191-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "cinder-a0654b83-5657-4511-b577-17e56379f28b-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-a0654b83-5657-4511-b577-17e56379f28b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "cinder-quobyte-a0654b83-5657-4511-b577-17e56379f28b" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-quobyte-a0654b83-5657-4511-b577-17e56379f28b" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Acquiring lock "cinder-53199859-0129-407b-be53-30adaf1c2524-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "cinder-53199859-0129-407b-be53-30adaf1c2524-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c11eec-94c3-4626-84e7-864e103207d8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Acquiring lock "cinder-quobyte-53199859-0129-407b-be53-30adaf1c2524" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "cinder-quobyte-53199859-0129-407b-be53-30adaf1c2524" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5822e2c-5107-4ce5-bd84-f549e0458853]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b Sep 23 00:18:51 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:51 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 Sep 23 00:18:51 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:52 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b" returned: 0 in 0.592s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:52 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b Sep 23 00:18:52 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:52 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524" returned: 0 in 0.745s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:52 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524 Sep 23 00:18:52 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:52 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0654b83-5657-4511-b577-17e56379f28b" returned: 0 in 0.594s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-quobyte-a0654b83-5657-4511-b577-17e56379f28b" released by "delete_volume" :: held 1.305s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Created reservations ['bdbc5c20-6d09-4a91-9d3a-0a7cb43c3df5', '08a9dc36-a24c-4476-84e7-4b28831e1024', '33b05dc7-ea3d-4e81-ab19-9d9c4a20628f', '59c75e77-e9a7-4649-a2db-1663f3757eb4', '4a2a0bc6-ce36-4df6-b43a-1be96e1cd087'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:52 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-53199859-0129-407b-be53-30adaf1c2524" returned: 0 in 0.633s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "cinder-quobyte-53199859-0129-407b-be53-30adaf1c2524" released by "delete_volume" :: held 1.456s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:53 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:53 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Created reservations ['d77f1116-668f-4b2a-8a54-56ce224da0dd', 'fdec329b-ed68-4a5a-9266-7d91b67b4ece', '2eb851d5-e39c-4014-8865-704e855357b0', '2fbbc1be-9d87-4e8f-8d46-72e191f87a15', 'aa0b1e25-e058-46ab-86ae-7b461dc89866'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:53 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.513s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Deleted volume successfully. Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6983ff37-dfb1-4209-b0d8-042d9128fd1b tempest-ServerActionsTestOtherA-774435999 None] Lock "cinder-a0654b83-5657-4511-b577-17e56379f28b-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:53 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.589s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Deleted volume successfully. Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d36f133e-bcd0-4631-9474-c4ac8631ac5f tempest-VolumeQuotasNegativeTestJSON-1486053111 None] Lock "cinder-53199859-0129-407b-be53-30adaf1c2524-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:54 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:18:54 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:55 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.529s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:18:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Flow 'volume_create_manager' (98404b03-b4d3-4302-bae3-a6a94052e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5ea69d-bcfa-4b2f-9ef0-73a1cd4e52e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5ea69d-bcfa-4b2f-9ef0-73a1cd4e52e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1380242718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825528a5-b942-482a-a3a3-4a408d6c9e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db77a15dd774f96b0eec8e4a001e841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:59Z,use_quota=True,user_id='5a2a3b8349894aec93a9055d11cd00f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082b6c9f-28ed-46e7-aae8-0f07d8eccce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082b6c9f-28ed-46e7-aae8-0f07d8eccce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8620413-4d3b-4793-b8b5-1f1ff12b1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8620413-4d3b-4793-b8b5-1f1ff12b1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825528a5-b942-482a-a3a3-4a408d6c9e8c', 'volume_name': 'volume-825528a5-b942-482a-a3a3-4a408d6c9e8c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd074da-f8eb-437c-bd27-04de2b9a3c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd074da-f8eb-437c-bd27-04de2b9a3c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad20f5b8-bcc2-44da-94a9-44da4f0f31b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Volume 825528a5-b942-482a-a3a3-4a408d6c9e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825528a5-b942-482a-a3a3-4a408d6c9e8c', 'volume_size': 1} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1380242718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825528a5-b942-482a-a3a3-4a408d6c9e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db77a15dd774f96b0eec8e4a001e841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:59Z,use_quota=True,user_id='5a2a3b8349894aec93a9055d11cd00f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Creating volume 825528a5-b942-482a-a3a3-4a408d6c9e8c {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:59 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:18:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:59 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c 1073741824 Sep 23 00:18:59 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:00 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c 1073741824" returned: 0 in 0.689s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:00 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c Sep 23 00:19:00 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:00 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c" returned: 0 in 0.471s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad20f5b8-bcc2-44da-94a9-44da4f0f31b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825528a5-b942-482a-a3a3-4a408d6c9e8c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b64183-28ff-4855-ab4f-85030967ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:00 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Volume volume-825528a5-b942-482a-a3a3-4a408d6c9e8c (825528a5-b942-482a-a3a3-4a408d6c9e8c): created successfully Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b64183-28ff-4855-ab4f-85030967ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Flow 'volume_create_manager' (98404b03-b4d3-4302-bae3-a6a94052e170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5e679527-d570-44a3-b862-a86e5a04252c tempest-VolumesMetadataTest-578920173 None] Created volume successfully. Sep 23 00:19:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Acquiring lock "cinder-825528a5-b942-482a-a3a3-4a408d6c9e8c-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Lock "cinder-825528a5-b942-482a-a3a3-4a408d6c9e8c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Acquiring lock "cinder-quobyte-825528a5-b942-482a-a3a3-4a408d6c9e8c" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Lock "cinder-quobyte-825528a5-b942-482a-a3a3-4a408d6c9e8c" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:03 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8f04a-c59a-44ca-a1c7-8a648addf15c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:03 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c Sep 23 00:19:03 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c" returned: 0 in 0.855s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:04 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c Sep 23 00:19:04 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-825528a5-b942-482a-a3a3-4a408d6c9e8c" returned: 0 in 0.768s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Lock "cinder-quobyte-825528a5-b942-482a-a3a3-4a408d6c9e8c" released by "delete_volume" :: held 1.750s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Created reservations ['098375a5-a644-4033-8e64-0bf59ee7ad64', '1fa2d3fb-f614-44c8-89db-8351842ee15a', '841ad95f-20d8-492a-bf61-e5120719a167', 'fbe771be-641a-4e46-860b-dd3d2060e03f', '5bd803f9-6755-4bea-8f4a-78a806f709de'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:19:05 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.596s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Deleted volume successfully. Sep 23 00:19:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6e83f2d4-c077-4c30-86c5-49839521dac7 tempest-VolumesMetadataTest-578920173 None] Lock "cinder-825528a5-b942-482a-a3a3-4a408d6c9e8c-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Flow 'volume_create_manager' (9b2c023a-8419-4677-8831-04c6ce4150ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62549fd-577c-49da-bd1f-228b69436d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62549fd-577c-49da-bd1f-228b69436d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1830310067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50b2418-75c5-4556-84a3-67b457b445f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee356aef25d403792533b096b4eab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:14Z,use_quota=True,user_id='3f7d8625499c40e9b954e75d65465e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ddd71c-6974-4420-bb85-3b0aede2f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ddd71c-6974-4420-bb85-3b0aede2f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45550460-2ef4-4d80-8500-8c151476f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45550460-2ef4-4d80-8500-8c151476f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50b2418-75c5-4556-84a3-67b457b445f8', 'volume_name': 'volume-a50b2418-75c5-4556-84a3-67b457b445f8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa59bb4f-afe0-4292-8145-cdea6bcc64b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa59bb4f-afe0-4292-8145-cdea6bcc64b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7ee385-9865-42de-a374-bdcd711ec526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:14 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Volume a50b2418-75c5-4556-84a3-67b457b445f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50b2418-75c5-4556-84a3-67b457b445f8', 'volume_size': 1} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1830310067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50b2418-75c5-4556-84a3-67b457b445f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee356aef25d403792533b096b4eab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:14Z,use_quota=True,user_id='3f7d8625499c40e9b954e75d65465e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Creating volume a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:14 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:14 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 1073741824 Sep 23 00:19:14 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:14 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 1073741824" returned: 0 in 0.718s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:15 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 Sep 23 00:19:15 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:15 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8" returned: 0 in 0.443s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7ee385-9865-42de-a374-bdcd711ec526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50b2418-75c5-4556-84a3-67b457b445f8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f4cf9f-a17a-4a09-a1a9-30b839d7a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:15 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Volume volume-a50b2418-75c5-4556-84a3-67b457b445f8 (a50b2418-75c5-4556-84a3-67b457b445f8): created successfully Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f4cf9f-a17a-4a09-a1a9-30b839d7a183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Flow 'volume_create_manager' (9b2c023a-8419-4677-8831-04c6ce4150ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-950056b5-2716-4172-a9ef-bc4781379caf tempest-VolumesCloneTest-1758317379 None] Created volume successfully. Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Flow 'volume_create_manager' (4758da5c-a46f-4c25-8a92-386d5ff73849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e50bd6-b729-4d80-aa78-d26fdacaca1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e50bd6-b729-4d80-aa78-d26fdacaca1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1427996864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4978116e-2eec-4c0b-aaad-a9ed41889287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee356aef25d403792533b096b4eab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a50b2418-75c5-4556-84a3-67b457b445f8,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:17Z,use_quota=True,user_id='3f7d8625499c40e9b954e75d65465e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aea5fdf-97e8-4487-8361-2b160f71a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aea5fdf-97e8-4487-8361-2b160f71a84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55677d1e-0193-46cc-a2ae-3f98b2703df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55677d1e-0193-46cc-a2ae-3f98b2703df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4978116e-2eec-4c0b-aaad-a9ed41889287', 'volume_name': 'volume-4978116e-2eec-4c0b-aaad-a9ed41889287', 'volume_size': 2, 'source_volid': 'a50b2418-75c5-4556-84a3-67b457b445f8', 'source_volstatus': 'available'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdd1da4-5ab4-4de2-b5e2-9751091deb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdd1da4-5ab4-4de2-b5e2-9751091deb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da347a6-c78d-4230-8091-ebdb6c86762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:17 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Volume 4978116e-2eec-4c0b-aaad-a9ed41889287: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4978116e-2eec-4c0b-aaad-a9ed41889287', 'volume_size': 2, 'source_volid': 'a50b2418-75c5-4556-84a3-67b457b445f8', 'source_volstatus': 'available'} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:17 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Cloning volume a50b2418-75c5-4556-84a3-67b457b445f8 to volume 4978116e-2eec-4c0b-aaad-a9ed41889287 Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Creating offline snapshot 2dabf527-7f58-48e9-a960-23546f0a20ea of volume a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[652011ab-35f5-4bb9-86d7-2d4b06d3c534]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 Sep 23 00:19:17 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8" returned: 0 in 0.615s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea 1G Sep 23 00:19:18 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Flow 'volume_create_manager' (13791753-9e32-4d71-aa3a-d05f73fdd77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa52cf8-3da7-41b4-b870-0b8b4aa6414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa52cf8-3da7-41b4-b870-0b8b4aa6414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1448525616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba33eb1d-48f9-467d-8f47-08decd592ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868c65324b064895aca3460aa19fd108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:19Z,use_quota=True,user_id='8043ba68add743c487b749cc6865c2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81efaa5-9cf7-449b-94e9-1a25bd382843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81efaa5-9cf7-449b-94e9-1a25bd382843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c128c621-632a-484c-ab2c-b8fd0ef01422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:19:18 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea 1G" returned: 0 in 0.866s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50b2418-75c5-4556-84a3-67b457b445f8 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50b2418-75c5-4556-84a3-67b457b445f8 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea Sep 23 00:19:19 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c128c621-632a-484c-ab2c-b8fd0ef01422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba33eb1d-48f9-467d-8f47-08decd592ae3', 'volume_name': 'volume-ba33eb1d-48f9-467d-8f47-08decd592ae3', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d0d313-d3ba-47c5-87c2-6e9968299a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d0d313-d3ba-47c5-87c2-6e9968299a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7747421e-0871-4591-9754-777ebb681651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Volume ba33eb1d-48f9-467d-8f47-08decd592ae3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba33eb1d-48f9-467d-8f47-08decd592ae3', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Trying to clone ba33eb1d-48f9-467d-8f47-08decd592ae3 from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:19:19 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50b2418-75c5-4556-84a3-67b457b445f8 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea" returned: 0 in 0.624s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea is being set with open permissions: ugo+rw Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:19:19 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:19:19 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea Sep 23 00:19:19 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7701370-47bc-47e0-9c91-2cd64e8a0ad9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD Sep 23 00:19:19 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea" returned: 0 in 0.320s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info Sep 23 00:19:20 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 is fetched for user 8043ba68add743c487b749cc6865c2e3. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f07c76-c25f-4039-8655-5308656bdccb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info is being set with open permissions: ugo+rw Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD Sep 23 00:19:20 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info Sep 23 00:19:20 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:20 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.info" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Acquiring lock "cinder-quobyte-4978116e-2eec-4c0b-aaad-a9ed41889287" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-4978116e-2eec-4c0b-aaad-a9ed41889287" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] snapshot: 2dabf527-7f58-48e9-a960-23546f0a20ea, volume: 4978116e-2eec-4c0b-aaad-a9ed41889287, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cea6d2-a42a-4020-a9c3-7ada403acd49]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea Sep 23 00:19:20 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea" returned: 0 in 0.422s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a50b2418-75c5-4556-84a3-67b457b445f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668a8fc-1559-446b-83de-ba6bc914ce0a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 Sep 23 00:19:21 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8" returned: 0 in 0.563s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:19:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 Sep 23 00:19:21 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=60,cinder:INSERT=19,cinder:UPDATE=65,cinder:DELETE=7 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=55,cinder:INSERT=18,cinder:UPDATE=69,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:30 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287" returned: 0 in 8.701s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:30 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Converted 1024.00 MB image at 117.67 MB/s Sep 23 00:19:30 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 is being set with open permissions: ugo+rw Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:30 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 Sep 23 00:19:30 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:30 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287" returned: 0 in 0.299s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-4978116e-2eec-4c0b-aaad-a9ed41889287" released by "_copy_volume_from_snapshot" :: held 10.092s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Acquiring lock "cinder-quobyte-2dabf527-7f58-48e9-a960-23546f0a20ea" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-2dabf527-7f58-48e9-a960-23546f0a20ea" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Deleting offline snapshot 2dabf527-7f58-48e9-a960-23546f0a20ea of volume a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] snapshot_file for this snap is: volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:31 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a7538-a78f-435a-99e7-3ed10d86c0d5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:31 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea Sep 23 00:19:31 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea" returned: 0 in 0.812s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a50b2418-75c5-4556-84a3-67b457b445f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:31 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb897e-b2f2-470d-a44d-9a56bea342b5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 Sep 23 00:19:32 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:32 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8" returned: 0 in 0.811s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea Sep 23 00:19:32 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea" returned: 0 in 0.674s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea Sep 23 00:19:33 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8.2dabf527-7f58-48e9-a960-23546f0a20ea" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-2dabf527-7f58-48e9-a960-23546f0a20ea" released by "_delete_snapshot" :: held 2.926s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.485s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.215s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1448525616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba33eb1d-48f9-467d-8f47-08decd592ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868c65324b064895aca3460aa19fd108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:19Z,use_quota=True,user_id='8043ba68add743c487b749cc6865c2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Creating volume ba33eb1d-48f9-467d-8f47-08decd592ae3 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:33 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 1073741824 Sep 23 00:19:33 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da347a6-c78d-4230-8091-ebdb6c86762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4978116e-2eec-4c0b-aaad-a9ed41889287', 'volume_size': 2, 'source_volid': 'a50b2418-75c5-4556-84a3-67b457b445f8', 'source_volstatus': 'available'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd44cca0-a71c-4b2c-9091-a675335edf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Volume volume-4978116e-2eec-4c0b-aaad-a9ed41889287 (4978116e-2eec-4c0b-aaad-a9ed41889287): created successfully Sep 23 00:19:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd44cca0-a71c-4b2c-9091-a675335edf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Flow 'volume_create_manager' (4758da5c-a46f-4c25-8a92-386d5ff73849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cef43152-8162-4b41-92e4-0e1044d1ebdb tempest-VolumesCloneTest-1758317379 None] Created volume successfully. Sep 23 00:19:34 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 1073741824" returned: 0 in 1.002s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 Sep 23 00:19:35 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Acquiring lock "cinder-4978116e-2eec-4c0b-aaad-a9ed41889287-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Lock "cinder-4978116e-2eec-4c0b-aaad-a9ed41889287-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Acquiring lock "cinder-quobyte-4978116e-2eec-4c0b-aaad-a9ed41889287" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-4978116e-2eec-4c0b-aaad-a9ed41889287" acquired by "delete_volume" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:35 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3" returned: 0 in 0.549s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bcf754-2b3c-498b-9839-86ae41ac6075]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Attempting download of 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume ba33eb1d-48f9-467d-8f47-08decd592ae3. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[67911c53-8df3-48e7-97ea-0e9a69efe5ac]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 Sep 23 00:19:35 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman Sep 23 00:19:35 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287" returned: 0 in 0.580s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287 Sep 23 00:19:36 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman" returned: 0 in 0.601s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman Sep 23 00:19:36 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4978116e-2eec-4c0b-aaad-a9ed41889287" returned: 0 in 0.466s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-4978116e-2eec-4c0b-aaad-a9ed41889287" released by "delete_volume" :: held 1.140s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Created reservations ['d586db5b-93be-4f0e-acdd-357f4e40e246', '2f170756-5ec5-4296-8114-6dfafb546462', '53b10175-534f-4129-b2af-ee89f72f55b5', '8b7c3f48-dd0f-4b0c-a1f7-6ef9f282e972', 'b4542006-a89d-4229-b6f9-3d9f2b3e748e'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:19:36 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman" returned: 1 in 0.625s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_47fqlman' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc5a0ac-d5be-4c20-91f4-481f63666c3d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD Sep 23 00:19:37 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.406s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Deleted volume successfully. Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12bfdaa4-e8b1-4748-bfcd-cd12074dcaba tempest-VolumesCloneTest-1758317379 None] Lock "cinder-4978116e-2eec-4c0b-aaad-a9ed41889287-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:37 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] 6eb882ce-4d61-40f4-9438-6ccb8337d906 was qcow2, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 Sep 23 00:19:37 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Acquiring lock "cinder-a50b2418-75c5-4556-84a3-67b457b445f8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Lock "cinder-a50b2418-75c5-4556-84a3-67b457b445f8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Acquiring lock "cinder-quobyte-a50b2418-75c5-4556-84a3-67b457b445f8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-a50b2418-75c5-4556-84a3-67b457b445f8" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cbf2cf-9d3e-4d92-a38b-c1361f6fbf0d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:38 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 Sep 23 00:19:38 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:38 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8" returned: 0 in 0.614s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-abcf1cc1-4523-4a85-b368-6ee2a4756194 req-e44864c4-f012-47a0-9332-99bf30fd2f39 tempest-AttachVolumeNegativeTest-2066461253 None] Terminate volume connection completed successfully. Sep 23 00:19:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-abcf1cc1-4523-4a85-b368-6ee2a4756194 req-e44864c4-f012-47a0-9332-99bf30fd2f39 tempest-AttachVolumeNegativeTest-2066461253 None] Deleting attachment f71a7408-5a16-4c54-a397-713a4d7db4b1. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:19:38 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8 Sep 23 00:19:38 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a50b2418-75c5-4556-84a3-67b457b445f8" returned: 0 in 0.447s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Lock "cinder-quobyte-a50b2418-75c5-4556-84a3-67b457b445f8" released by "delete_volume" :: held 1.192s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Created reservations ['53a7976c-e146-4bc5-a51f-6fa2ffd9477e', '72c2caaa-272e-4d68-b05a-12a8fdb3ada2', 'd04f9c62-07f5-475a-8dd1-c58cceb21c19', '39fba60e-c8b1-4e92-aba2-dcd8c434efb5', 'fa660397-18df-4e02-aaad-5da7b01a34d0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:19:39 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.490s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Deleted volume successfully. Sep 23 00:19:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37ab6396-5d29-4e12-9c37-60d6c7ee8e15 tempest-VolumesCloneTest-1758317379 None] Lock "cinder-a50b2418-75c5-4556-84a3-67b457b445f8-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3" returned: 0 in 3.443s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906__85gl9rcdevstack@QuobyteHD, size 112.00 MB, duration 3.44 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:40 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Converted 112.00 MB image at 32.52 MB/s Sep 23 00:19:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 1G Sep 23 00:19:40 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 1G" returned: 0 in 0.738s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Downloaded image 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume ba33eb1d-48f9-467d-8f47-08decd592ae3 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 for user 8043ba68add743c487b749cc6865c2e3 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Marking volume ba33eb1d-48f9-467d-8f47-08decd592ae3 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Copying metadata from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 to ba33eb1d-48f9-467d-8f47-08decd592ae3. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Creating volume glance metadata for volume ba33eb1d-48f9-467d-8f47-08decd592ae3 backed by image 6eb882ce-4d61-40f4-9438-6ccb8337d906 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7747421e-0871-4591-9754-777ebb681651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba33eb1d-48f9-467d-8f47-08decd592ae3', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966ac292-3607-4a3c-96c8-d5d2a5780d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Volume volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 (ba33eb1d-48f9-467d-8f47-08decd592ae3): created successfully Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966ac292-3607-4a3c-96c8-d5d2a5780d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Flow 'volume_create_manager' (13791753-9e32-4d71-aa3a-d05f73fdd77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-adc0a375-5489-45ca-988c-569b8717c283 tempest-VolumesImageMetadata-2111299439 None] Created volume successfully. Sep 23 00:19:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Acquiring lock "cinder-ba33eb1d-48f9-467d-8f47-08decd592ae3-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Lock "cinder-ba33eb1d-48f9-467d-8f47-08decd592ae3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Acquiring lock "cinder-quobyte-ba33eb1d-48f9-467d-8f47-08decd592ae3" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Lock "cinder-quobyte-ba33eb1d-48f9-467d-8f47-08decd592ae3" acquired by "delete_volume" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:43 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea324b-d661-4374-8c40-1b1c6d918112]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 Sep 23 00:19:44 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3" returned: 0 in 0.616s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3 Sep 23 00:19:44 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba33eb1d-48f9-467d-8f47-08decd592ae3" returned: 0 in 0.607s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Lock "cinder-quobyte-ba33eb1d-48f9-467d-8f47-08decd592ae3" released by "delete_volume" :: held 1.292s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Created reservations ['b1846329-3081-40f3-aa39-afb480033c4e', 'c2a1d0f6-970d-42fd-a4f6-4f2446c086a8', '0f6dc78c-685a-4559-96e4-5b5c414721a1', '9dd0463a-418e-4c04-b216-6620412ca152', 'a29889ac-e5cf-4412-9b00-bb34ff80a959'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:19:45 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.265s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:45 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Deleted volume successfully. Sep 23 00:19:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-41528ef4-356d-428a-90d2-52f37a56d0dd tempest-VolumesImageMetadata-2111299439 None] Lock "cinder-ba33eb1d-48f9-467d-8f47-08decd592ae3-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Flow 'volume_create_manager' (9fed0516-136c-4b17-907d-4047b1bb2c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dbefbe-3e30-48fd-9e87-f277a8e9280e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dbefbe-3e30-48fd-9e87-f277a8e9280e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1352469318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd14ed9-938a-48cf-a7c7-30a8452cca00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b16e1818540e488c39a4a6e5acec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:48Z,use_quota=True,user_id='4511713031344a2999cd7eeb3d4c45f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd8322-5c51-4af2-b3ba-741b5f8eb559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd8322-5c51-4af2-b3ba-741b5f8eb559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98287b7f-3962-45c8-9c18-7152e131f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98287b7f-3962-45c8-9c18-7152e131f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd14ed9-938a-48cf-a7c7-30a8452cca00', 'volume_name': 'volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00', 'volume_size': 2}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fe57ca-d83a-4448-bbc6-d060424b3bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fe57ca-d83a-4448-bbc6-d060424b3bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a659410b-ae9c-4e18-a536-48551d88d405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Volume fdd14ed9-938a-48cf-a7c7-30a8452cca00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00', 'volume_size': 2} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1352469318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd14ed9-938a-48cf-a7c7-30a8452cca00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92b16e1818540e488c39a4a6e5acec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:48Z,use_quota=True,user_id='4511713031344a2999cd7eeb3d4c45f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Creating volume fdd14ed9-938a-48cf-a7c7-30a8452cca00 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:48 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:19:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 2147483648 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:48 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 2147483648 Sep 23 00:19:48 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:49 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 2147483648" returned: 0 in 0.973s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:49 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 Sep 23 00:19:49 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:50 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00" returned: 0 in 0.616s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a659410b-ae9c-4e18-a536-48551d88d405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00', 'volume_size': 2}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48472e0e-3637-446b-910d-0c4f6c91018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:50 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Volume volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 (fdd14ed9-938a-48cf-a7c7-30a8452cca00): created successfully Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48472e0e-3637-446b-910d-0c4f6c91018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Flow 'volume_create_manager' (9fed0516-136c-4b17-907d-4047b1bb2c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0eba9471-2529-4d0f-bf4b-5bf00847a3cf tempest-VolumesCloneNegativeTest-175608253 None] Created volume successfully. Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Acquiring lock "cinder-fdd14ed9-938a-48cf-a7c7-30a8452cca00-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Lock "cinder-fdd14ed9-938a-48cf-a7c7-30a8452cca00-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Acquiring lock "cinder-quobyte-fdd14ed9-938a-48cf-a7c7-30a8452cca00" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Lock "cinder-quobyte-fdd14ed9-938a-48cf-a7c7-30a8452cca00" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13880f-1d45-477f-a268-42365e372390]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:51 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 Sep 23 00:19:51 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:51 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00" returned: 0 in 0.813s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:51 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00 Sep 23 00:19:51 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:52 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fdd14ed9-938a-48cf-a7c7-30a8452cca00" returned: 0 in 0.429s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Lock "cinder-quobyte-fdd14ed9-938a-48cf-a7c7-30a8452cca00" released by "delete_volume" :: held 1.326s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Created reservations ['04298bc2-aed3-45f7-ad87-5ba5e5754062', 'f08568e4-9420-451e-968e-304c2a05bbb5', 'd8908e26-4a4b-4040-9cca-179ff58bed5c', '82307264-8ed6-4a63-aba9-674a56436c7b', 'c2c67a02-9b17-49f1-86bd-f022118f553b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:52 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:19:52 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:53 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.425s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Deleted volume successfully. Sep 23 00:19:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-287b6285-7f00-41e0-bf9f-4524f86ecc74 tempest-VolumesCloneNegativeTest-175608253 None] Lock "cinder-fdd14ed9-938a-48cf-a7c7-30a8452cca00-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:54 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:19:54 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:55 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.588s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:19:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Flow 'volume_create_manager' (9c032606-76d0-467e-be50-2ba0908ebcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98547ea1-3d5f-4256-b367-def1b25421a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98547ea1-3d5f-4256-b367-def1b25421a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-821463837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e1b907-0d57-4545-92b8-1e762ec89f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d142e1cf2e684c1db8b52ff8b15fd947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:57Z,use_quota=True,user_id='c235d4bbaf6c4b5a9b0d5d5c5eda6305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c455e8-901a-4c01-bac6-a1e6540feec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c455e8-901a-4c01-bac6-a1e6540feec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b852d571-e726-4bd2-9938-c7248a232f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b852d571-e726-4bd2-9938-c7248a232f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e1b907-0d57-4545-92b8-1e762ec89f06', 'volume_name': 'volume-00e1b907-0d57-4545-92b8-1e762ec89f06', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea1065c-65df-416e-87ce-ecb40186fe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea1065c-65df-416e-87ce-ecb40186fe53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce95dfdf-0ef8-49e9-aad9-76e8939ce89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:57 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Volume 00e1b907-0d57-4545-92b8-1e762ec89f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e1b907-0d57-4545-92b8-1e762ec89f06', 'volume_size': 1} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-821463837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e1b907-0d57-4545-92b8-1e762ec89f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d142e1cf2e684c1db8b52ff8b15fd947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:57Z,use_quota=True,user_id='c235d4bbaf6c4b5a9b0d5d5c5eda6305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Creating volume 00e1b907-0d57-4545-92b8-1e762ec89f06 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:57 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:19:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:57 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 1073741824 Sep 23 00:19:57 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:58 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 1073741824" returned: 0 in 1.017s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:58 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 Sep 23 00:19:58 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:59 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06" returned: 0 in 0.620s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce95dfdf-0ef8-49e9-aad9-76e8939ce89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e1b907-0d57-4545-92b8-1e762ec89f06', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fe72c9-d48b-412a-8afc-ce61bf6477a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:59 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Volume volume-00e1b907-0d57-4545-92b8-1e762ec89f06 (00e1b907-0d57-4545-92b8-1e762ec89f06): created successfully Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fe72c9-d48b-412a-8afc-ce61bf6477a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Flow 'volume_create_manager' (9c032606-76d0-467e-be50-2ba0908ebcac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:59 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-803301b0-f938-4dbd-a45f-6b51645ee5da tempest-VolumesTransfersTest-2092398419 None] Created volume successfully. Sep 23 00:20:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2a04f415-3167-422a-a306-d7d5579c63cd tempest-VolumesTransfersTest-91526550 None] Transfer volume completed successfully. Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Flow 'volume_create_manager' (b9125bf0-62c7-4a59-897b-4003757ea37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd43f31f-091a-49b6-b21c-f1c977e0a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd43f31f-091a-49b6-b21c-f1c977e0a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2016182125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d212dd-fb5d-4203-9a71-c7ca3ba4f922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299d08fb9f8f4163813e8016bb449bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:03Z,use_quota=True,user_id='612c45deae944e69b8462303a6963d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ce0b3e-2d12-45ee-af7e-e13fb92b9e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ce0b3e-2d12-45ee-af7e-e13fb92b9e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b780672-0989-4d40-9279-1c900b880b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:03 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Acquiring lock "cinder-00e1b907-0d57-4545-92b8-1e762ec89f06-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-00e1b907-0d57-4545-92b8-1e762ec89f06-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b780672-0989-4d40-9279-1c900b880b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3d212dd-fb5d-4203-9a71-c7ca3ba4f922', 'volume_name': 'volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bd75f6-f226-479d-9f9e-355896318d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bd75f6-f226-479d-9f9e-355896318d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233145d5-b376-42fc-b48b-8aad9890874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Volume a3d212dd-fb5d-4203-9a71-c7ca3ba4f922: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Trying to clone a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Acquiring lock "cinder-quobyte-00e1b907-0d57-4545-92b8-1e762ec89f06" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-quobyte-00e1b907-0d57-4545-92b8-1e762ec89f06" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb84a1-6c40-456d-81f1-2457320999ab]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 Sep 23 00:20:05 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD, size 20.69 MB, duration 1.10 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:20:05 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Image download 20.69 MB at 18.76 MB/s Sep 23 00:20:05 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f8f90-2cf5-4c0d-ba5e-4442008464bd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06" returned: 0 in 1.188s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06 Sep 23 00:20:06 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD Sep 23 00:20:06 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-00e1b907-0d57-4545-92b8-1e762ec89f06" returned: 0 in 0.520s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-quobyte-00e1b907-0d57-4545-92b8-1e762ec89f06" released by "delete_volume" :: held 1.823s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:06 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD" returned: 0 in 0.697s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 is fetched for user 612c45deae944e69b8462303a6963d79. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Created reservations ['c65f9a3c-661b-4faf-b658-2f2f36241502', '1890c231-a243-41e4-9d27-30af9e05ce4a', '03240c55-de5a-4d3f-8ff2-fd14af5b405c', '9a8d619b-3b20-4dfc-a3df-551d4e6598d7', 'fa71f66c-82ac-42c8-b6d7-8936b37e9f1f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a183ae9-acfc-4870-97ed-696e3326382e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:20:06 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD Sep 23 00:20:06 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.426s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Deleted volume successfully. Sep 23 00:20:07 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2016182125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d212dd-fb5d-4203-9a71-c7ca3ba4f922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299d08fb9f8f4163813e8016bb449bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:03Z,use_quota=True,user_id='612c45deae944e69b8462303a6963d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Creating volume a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:07 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2213b4ea-09df-4dba-a9ad-2b51ec94460f tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-00e1b907-0d57-4545-92b8-1e762ec89f06-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:07 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 1073741824 Sep 23 00:20:07 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Flow 'volume_create_manager' (333cdf2c-a115-4bfe-987c-b91387d62d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:08 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec5f96-be1f-46dc-af65-72f5b2f98bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 1073741824" returned: 0 in 0.831s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec5f96-be1f-46dc-af65-72f5b2f98bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2123806859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b0c50-2704-483a-82ed-64dcb9ab0620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d142e1cf2e684c1db8b52ff8b15fd947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:08Z,use_quota=True,user_id='c235d4bbaf6c4b5a9b0d5d5c5eda6305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6b46c5-85f4-4d30-aedb-df5f3717e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6b46c5-85f4-4d30-aedb-df5f3717e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed09030d-8253-4b29-bcd8-24b1cef14cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed09030d-8253-4b29-bcd8-24b1cef14cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117b0c50-2704-483a-82ed-64dcb9ab0620', 'volume_name': 'volume-117b0c50-2704-483a-82ed-64dcb9ab0620', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b979fc8-c9eb-408f-8cfa-fcd122d316b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b979fc8-c9eb-408f-8cfa-fcd122d316b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770bc823-c7d6-4b9f-9a32-108082d91088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Volume 117b0c50-2704-483a-82ed-64dcb9ab0620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117b0c50-2704-483a-82ed-64dcb9ab0620', 'volume_size': 1} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:08 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 Sep 23 00:20:08 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:08 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" returned: 0 in 0.301s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2123806859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b0c50-2704-483a-82ed-64dcb9ab0620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d142e1cf2e684c1db8b52ff8b15fd947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:08Z,use_quota=True,user_id='c235d4bbaf6c4b5a9b0d5d5c5eda6305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Creating volume 117b0c50-2704-483a-82ed-64dcb9ab0620 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:08 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:08 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 1073741824 Sep 23 00:20:08 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Attempting download of 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume a3d212dd-fb5d-4203-9a71-c7ca3ba4f922. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db410ea-d7ff-4b3f-aeb7-e023b97b89fa]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:08 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte Sep 23 00:20:08 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:09 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte" returned: 0 in 0.579s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 1073741824" returned: 0 in 0.831s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:09 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte Sep 23 00:20:09 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 Sep 23 00:20:09 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:09 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte" returned: 1 in 0.438s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_2xa86qte' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[01448c9b-af2b-4bf3-9100-45739ee27eb4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620" returned: 0 in 0.345s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770bc823-c7d6-4b9f-9a32-108082d91088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117b0c50-2704-483a-82ed-64dcb9ab0620', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83f28ff-8e08-46ee-8f29-aa6bc5ae96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:09 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD Sep 23 00:20:09 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:09 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Volume volume-117b0c50-2704-483a-82ed-64dcb9ab0620 (117b0c50-2704-483a-82ed-64dcb9ab0620): created successfully Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83f28ff-8e08-46ee-8f29-aa6bc5ae96da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Flow 'volume_create_manager' (333cdf2c-a115-4bfe-987c-b91387d62d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-eebf3cd1-43cb-4e30-9895-e179809714e9 tempest-VolumesTransfersTest-2092398419 None] Created volume successfully. Sep 23 00:20:10 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] 6eb882ce-4d61-40f4-9438-6ccb8337d906 was qcow2, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 Sep 23 00:20:10 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Acquiring lock "cinder-117b0c50-2704-483a-82ed-64dcb9ab0620-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-117b0c50-2704-483a-82ed-64dcb9ab0620-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Acquiring lock "cinder-quobyte-117b0c50-2704-483a-82ed-64dcb9ab0620" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-quobyte-117b0c50-2704-483a-82ed-64dcb9ab0620" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2097f25-8af9-4af9-8170-7f49d8234f69]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 Sep 23 00:20:10 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620" returned: 0 in 0.607s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:11 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620 Sep 23 00:20:11 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-117b0c50-2704-483a-82ed-64dcb9ab0620" returned: 0 in 0.403s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-quobyte-117b0c50-2704-483a-82ed-64dcb9ab0620" released by "delete_volume" :: held 1.089s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:11 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Created reservations ['fa405546-dad6-4b31-abbc-13cb4c2e0922', '6e5e31d0-0eb9-413c-b7e9-0124cc6cc389', 'efb4c284-24d1-4266-bd02-4aaf3c813dce', '3b5a0aa3-176d-4612-98b8-d11e131cac60', '01473b78-dbf7-4032-80c4-c54af7708792'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:20:12 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.472s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Deleted volume successfully. Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d82193b9-9e7b-49b9-a36f-cec5ac99c5b1 tempest-VolumesTransfersTest-1377324353 None] Lock "cinder-117b0c50-2704-483a-82ed-64dcb9ab0620-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:12 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" returned: 0 in 2.670s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_i8yuc3w0devstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:20:12 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Converted 112.00 MB image at 41.94 MB/s Sep 23 00:20:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 1G Sep 23 00:20:12 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:13 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 1G" returned: 0 in 0.657s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Downloaded image 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 for user 612c45deae944e69b8462303a6963d79 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Marking volume a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Copying metadata from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 to a3d212dd-fb5d-4203-9a71-c7ca3ba4f922. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Creating volume glance metadata for volume a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 backed by image 6eb882ce-4d61-40f4-9438-6ccb8337d906 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233145d5-b376-42fc-b48b-8aad9890874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac104153-08a1-43bf-939a-4b08dcf2732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Volume volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 (a3d212dd-fb5d-4203-9a71-c7ca3ba4f922): created successfully Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac104153-08a1-43bf-939a-4b08dcf2732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Flow 'volume_create_manager' (b9125bf0-62c7-4a59-897b-4003757ea37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1a9fb460-b9ab-419b-b0d7-f7ae3c1b3648 tempest-VolumesExtendTest-476175672 None] Created volume successfully. Sep 23 00:20:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a2612-5ba6-48c4-a8da-14b8142efe42]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:14 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 Sep 23 00:20:14 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" returned: 0 in 0.707s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 2G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 2G" returned: 0 in 0.163s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.923s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-01838007-c4c9-4b30-bc14-3f0e9d3afdc5 tempest-VolumesExtendTest-476175672 None] Extend volume completed successfully. Sep 23 00:20:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Lock "cinder-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-quobyte-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f092b0b-d3e0-4152-8f2d-a1f9a5208eb2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 Sep 23 00:20:16 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" returned: 0 in 0.839s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:17 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922 Sep 23 00:20:17 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Flow 'volume_create_manager' (47212f52-ac98-4bd4-9c1d-9a5b2f116995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd64cfa-2ddd-4083-bbe9-f3fe4366b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd64cfa-2ddd-4083-bbe9-f3fe4366b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1608873462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7569a5cb-2a59-47c2-a82c-893d5cce76c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4e89b317bb4205817ec42c99637ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:18Z,use_quota=True,user_id='c3459e9d1941433892d7fcaca78e3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc2f217-99d6-47e7-a4d9-f72928031795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc2f217-99d6-47e7-a4d9-f72928031795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ee9530-fbe7-4485-bb83-98ba4ba720e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ee9530-fbe7-4485-bb83-98ba4ba720e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7569a5cb-2a59-47c2-a82c-893d5cce76c8', 'volume_name': 'volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362966d6-f14f-44f2-9fd3-33dab28b4429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362966d6-f14f-44f2-9fd3-33dab28b4429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8459b980-5354-4b50-938c-a38e0ba937fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:17 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Volume 7569a5cb-2a59-47c2-a82c-893d5cce76c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8', 'volume_size': 1} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1608873462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7569a5cb-2a59-47c2-a82c-893d5cce76c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4e89b317bb4205817ec42c99637ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:18Z,use_quota=True,user_id='c3459e9d1941433892d7fcaca78e3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Creating volume 7569a5cb-2a59-47c2-a82c-893d5cce76c8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:17 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:18 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 1073741824 Sep 23 00:20:18 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:18 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" returned: 0 in 0.504s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922" released by "delete_volume" :: held 1.425s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Created reservations ['31149209-0613-4fe8-9302-7746eb5e9507', '9964c1d4-6504-4ca7-8970-456ef5f754e0', 'ae5ccd99-c4fc-4161-b33f-9d5eb9e6adaf', 'e2b6bef2-262f-4e7e-b93e-1a979f0b2277', '6cc78d49-385f-424d-996e-d9a3c9304b54'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:18 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:20:18 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:18 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 1073741824" returned: 0 in 0.747s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:18 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 Sep 23 00:20:18 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:19 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.571s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Deleted volume successfully. Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c5787-098e-48f4-b6ce-8c0ece8c5355 tempest-VolumesExtendTest-476175672 None] Lock "cinder-a3d212dd-fb5d-4203-9a71-c7ca3ba4f922-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:19 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8" returned: 0 in 0.504s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8459b980-5354-4b50-938c-a38e0ba937fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ce57be-a77d-4039-95d4-76ef170b3439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Volume volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 (7569a5cb-2a59-47c2-a82c-893d5cce76c8): created successfully Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ce57be-a77d-4039-95d4-76ef170b3439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Flow 'volume_create_manager' (47212f52-ac98-4bd4-9c1d-9a5b2f116995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b4f5095b-b44c-445a-b302-73b6412b3a2a tempest-AttachVolumeTestJSON-1628138625 None] Created volume successfully. Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Flow 'volume_create_manager' (48a8720d-e5f2-44c1-960a-31fb0a38151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72c78a9-215e-4038-8227-1cf3546cbe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72c78a9-215e-4038-8227-1cf3546cbe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2083938666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06350fa4-1381-4348-915c-46f40a10aba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299d08fb9f8f4163813e8016bb449bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:20Z,use_quota=True,user_id='612c45deae944e69b8462303a6963d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb4845c-ce54-4308-823b-05cd80858cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb4845c-ce54-4308-823b-05cd80858cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d0ede8-f9bf-4b2c-9f22-539e14228748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d0ede8-f9bf-4b2c-9f22-539e14228748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06350fa4-1381-4348-915c-46f40a10aba6', 'volume_name': 'volume-06350fa4-1381-4348-915c-46f40a10aba6', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2049c76-d62b-4cc5-bda4-83dc43c6c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2049c76-d62b-4cc5-bda4-83dc43c6c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e260c5ea-9cba-41f1-a92c-d4105e59b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Volume 06350fa4-1381-4348-915c-46f40a10aba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06350fa4-1381-4348-915c-46f40a10aba6', 'volume_size': 1} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2083938666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06350fa4-1381-4348-915c-46f40a10aba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299d08fb9f8f4163813e8016bb449bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:20Z,use_quota=True,user_id='612c45deae944e69b8462303a6963d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Creating volume 06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:19 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:19 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 1073741824 Sep 23 00:20:19 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 1073741824" returned: 0 in 0.929s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 Sep 23 00:20:20 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-f5f339c4-f4c5-4262-be81-d9e0468c32bd req-57ba7df9-e285-4a3b-b93c-dd7757905e06 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:21 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6" returned: 0 in 0.346s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-f5f339c4-f4c5-4262-be81-d9e0468c32bd req-57ba7df9-e285-4a3b-b93c-dd7757905e06 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.105s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e260c5ea-9cba-41f1-a92c-d4105e59b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06350fa4-1381-4348-915c-46f40a10aba6', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c1f584-ff82-4fa5-808d-e8acec1a29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-f5f339c4-f4c5-4262-be81-d9e0468c32bd req-57ba7df9-e285-4a3b-b93c-dd7757905e06 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:21 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Volume volume-06350fa4-1381-4348-915c-46f40a10aba6 (06350fa4-1381-4348-915c-46f40a10aba6): created successfully Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c1f584-ff82-4fa5-808d-e8acec1a29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Flow 'volume_create_manager' (48a8720d-e5f2-44c1-960a-31fb0a38151f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:21 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8e05ee40-e9df-48bc-90c6-def354a79ea1 tempest-VolumesExtendTest-476175672 None] Created volume successfully. Sep 23 00:20:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-f5f339c4-f4c5-4262-be81-d9e0468c32bd req-57ba7df9-e285-4a3b-b93c-dd7757905e06 tempest-AttachVolumeTestJSON-1628138625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '235bcbb6-d72b-41c2-8fd2-dda8b400da5a', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:20:21 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-f5f339c4-f4c5-4262-be81-d9e0468c32bd req-57ba7df9-e285-4a3b-b93c-dd7757905e06 tempest-AttachVolumeTestJSON-1628138625 None] attachment_update completed successfully. Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Creating offline snapshot 4341c3d1-880e-41ac-b8fc-9f19c3791e97 of volume 06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b2ceb9-129b-4720-a88a-da2360a69382]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:22 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 Sep 23 00:20:22 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:22 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6" returned: 0 in 0.436s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:22 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 1G Sep 23 00:20:22 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:23 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 1G" returned: 0 in 0.621s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06350fa4-1381-4348-915c-46f40a10aba6 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:23 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06350fa4-1381-4348-915c-46f40a10aba6 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 Sep 23 00:20:23 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:23 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06350fa4-1381-4348-915c-46f40a10aba6 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97" returned: 0 in 0.499s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:23 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 is being set with open permissions: ugo+rw Sep 23 00:20:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:23 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 Sep 23 00:20:23 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97" returned: 0 in 0.270s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:24 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info Sep 23 00:20:24 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info" returned: 0 in 0.372s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info is being set with open permissions: ugo+rw Sep 23 00:20:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:24 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info Sep 23 00:20:24 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.info" returned: 0 in 0.328s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9b56e73c-94aa-43d6-8e6d-3533c0684ec8 tempest-VolumesExtendTest-476175672 None] Create snapshot completed successfully Sep 23 00:20:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:25 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7e2d73-d987-48cc-815c-7900ec5f447f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 Sep 23 00:20:25 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:26 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6" returned: 0 in 0.547s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 2G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 2G" returned: 0 in 0.360s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.966s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:26 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0b3ca28c-4d3b-4448-a256-364be9a1aae5 tempest-VolumesExtendTest-476175672 None] Extend volume completed successfully. Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-4341c3d1-880e-41ac-b8fc-9f19c3791e97-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Lock "cinder-4341c3d1-880e-41ac-b8fc-9f19c3791e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-quobyte-06350fa4-1381-4348-915c-46f40a10aba6" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-06350fa4-1381-4348-915c-46f40a10aba6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-quobyte-4341c3d1-880e-41ac-b8fc-9f19c3791e97" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-4341c3d1-880e-41ac-b8fc-9f19c3791e97" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Deleting offline snapshot 4341c3d1-880e-41ac-b8fc-9f19c3791e97 of volume 06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] snapshot_file for this snap is: volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f98bf3-7851-4094-b595-0540331d5564]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:27 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 Sep 23 00:20:27 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:27 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97" returned: 0 in 0.631s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06350fa4-1381-4348-915c-46f40a10aba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd17cbf-8d23-49cf-8be4-7fb22c883961]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 Sep 23 00:20:28 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6" returned: 0 in 1.095s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 Sep 23 00:20:29 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:30 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97" returned: 0 in 1.138s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:30 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97 Sep 23 00:20:30 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:30 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6.4341c3d1-880e-41ac-b8fc-9f19c3791e97" returned: 0 in 0.702s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=107,cinder:SELECT=85,cinder:INSERT=37,cinder:DELETE=5 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:30 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=93,cinder:SELECT=88,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-4341c3d1-880e-41ac-b8fc-9f19c3791e97" released by "_delete_snapshot" :: held 3.881s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-06350fa4-1381-4348-915c-46f40a10aba6" released by "delete_snapshot" :: held 3.945s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Flow 'volume_create_manager' (1020bad1-849c-4154-9a91-924db8adc34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513944f7-c509-4192-8cf9-272d945ddf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513944f7-c509-4192-8cf9-272d945ddf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2080369433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86726322-ce96-456d-961e-60875930dbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c020f27bfd42d4a797e60e2bd94734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:31Z,use_quota=True,user_id='ba69648324d742cd96f26955462f1e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84250577-e2e7-4d35-9fb1-35098522d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84250577-e2e7-4d35-9fb1-35098522d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bfb8f0-60b0-48b5-826c-c92d868f5f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bfb8f0-60b0-48b5-826c-c92d868f5f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86726322-ce96-456d-961e-60875930dbfd', 'volume_name': 'volume-86726322-ce96-456d-961e-60875930dbfd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1299f9-e169-48f5-99cf-5b71f6938c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1299f9-e169-48f5-99cf-5b71f6938c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87e0155-8a21-43ac-ae24-23f794ecb5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Volume 86726322-ce96-456d-961e-60875930dbfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86726322-ce96-456d-961e-60875930dbfd', 'volume_size': 1} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2080369433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86726322-ce96-456d-961e-60875930dbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c020f27bfd42d4a797e60e2bd94734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:31Z,use_quota=True,user_id='ba69648324d742cd96f26955462f1e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Creating volume 86726322-ce96-456d-961e-60875930dbfd {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:31 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:31 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd 1073741824 Sep 23 00:20:31 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Created reservations ['ff3c8252-f385-4a91-adfe-b42f728c0edc', 'd5da168b-073c-4eee-aa90-88f6a2072063', '30f6ca36-b20b-430d-bd1a-3d5ea5c2490e', '1ff481ab-617b-467a-b373-a4a2aa08522f', '0f057431-cee0-4e7e-999a-0c2dc27f28e4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Delete snapshot completed successfully. Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffee4ff2-cc3c-4f27-a808-7d23d2ace01a tempest-VolumesExtendTest-476175672 None] Lock "cinder-4341c3d1-880e-41ac-b8fc-9f19c3791e97-delete_snapshot" released by "delete_snapshot" :: held 4.447s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-06350fa4-1381-4348-915c-46f40a10aba6-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Lock "cinder-06350fa4-1381-4348-915c-46f40a10aba6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Acquiring lock "cinder-quobyte-06350fa4-1381-4348-915c-46f40a10aba6" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-06350fa4-1381-4348-915c-46f40a10aba6" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41782f2e-f050-474d-b774-189e51a38aca]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:32 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd 1073741824" returned: 0 in 0.969s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:32 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 Sep 23 00:20:32 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:32 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd Sep 23 00:20:32 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:32 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6" returned: 0 in 0.585s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:32 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd" returned: 0 in 0.428s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:32 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6 Sep 23 00:20:32 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87e0155-8a21-43ac-ae24-23f794ecb5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86726322-ce96-456d-961e-60875930dbfd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e321d173-95ee-4770-a276-66d94aaa0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:32 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Volume volume-86726322-ce96-456d-961e-60875930dbfd (86726322-ce96-456d-961e-60875930dbfd): created successfully Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e321d173-95ee-4770-a276-66d94aaa0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Flow 'volume_create_manager' (1020bad1-849c-4154-9a91-924db8adc34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:32 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9b80c9b7-be2b-482d-a451-b0b552710eba tempest-AttachVolumeNegativeTest-2066461253 None] Created volume successfully. Sep 23 00:20:33 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-06350fa4-1381-4348-915c-46f40a10aba6" returned: 0 in 0.584s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Lock "cinder-quobyte-06350fa4-1381-4348-915c-46f40a10aba6" released by "delete_volume" :: held 1.301s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Created reservations ['73f19328-776c-4cc9-ab6f-95064cc18e63', '32880686-bd60-4074-b9d4-21441f720438', '4d3a7e97-a206-4990-b867-1ddc1b88848a', 'ff010d05-f4eb-43bb-b936-f745d2d34859', '70fe108f-9c98-42b7-9e48-b7592815b778'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:20:33 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:34 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.650s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:34 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Deleted volume successfully. Sep 23 00:20:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e1325dc-955e-4a17-b3d7-21824d95e210 tempest-VolumesExtendTest-476175672 None] Lock "cinder-06350fa4-1381-4348-915c-46f40a10aba6-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-2ebbfcf1-ba42-40eb-89cf-70a4becf2ffc req-9185b50d-7148-4b28-93a0-47339222cf26 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-2ebbfcf1-ba42-40eb-89cf-70a4becf2ffc req-9185b50d-7148-4b28-93a0-47339222cf26 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-2ebbfcf1-ba42-40eb-89cf-70a4becf2ffc req-9185b50d-7148-4b28-93a0-47339222cf26 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-2ebbfcf1-ba42-40eb-89cf-70a4becf2ffc req-9185b50d-7148-4b28-93a0-47339222cf26 tempest-AttachVolumeNegativeTest-2066461253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-86726322-ce96-456d-961e-60875930dbfd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c4cd3b5-821b-4abd-b5c8-5a13acadb1f7', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:20:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-2ebbfcf1-ba42-40eb-89cf-70a4becf2ffc req-9185b50d-7148-4b28-93a0-47339222cf26 tempest-AttachVolumeNegativeTest-2066461253 None] attachment_update completed successfully. Sep 23 00:20:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-fcf0f2ba-7600-4728-afb2-675bff6c7ce1 req-b57d92d7-884c-4275-b49a-7403c7f4799c tempest-AttachVolumeNegativeTest-2066461253 None] Terminate volume connection completed successfully. Sep 23 00:20:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-fcf0f2ba-7600-4728-afb2-675bff6c7ce1 req-b57d92d7-884c-4275-b49a-7403c7f4799c tempest-AttachVolumeNegativeTest-2066461253 None] Deleting attachment 2c4cd3b5-821b-4abd-b5c8-5a13acadb1f7. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Flow 'volume_create_manager' (9f022a6f-577d-4496-8b8a-435cfc698cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516d8046-debe-4b8e-b7d8-dec5ec7222dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516d8046-debe-4b8e-b7d8-dec5ec7222dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2079908223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a81d86-9e14-4791-88e7-248eb6811c95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79e2691deaf34bc5afe6850bf6e77054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:43Z,use_quota=True,user_id='ddc8b5a2b8b1452ead6a2a27320e6945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f54b67c-21b6-4818-a0c1-d4b2a90cc331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f54b67c-21b6-4818-a0c1-d4b2a90cc331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f8fd8b-3ce1-4b8b-97fc-85cff18520d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f8fd8b-3ce1-4b8b-97fc-85cff18520d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a81d86-9e14-4791-88e7-248eb6811c95', 'volume_name': 'volume-b1a81d86-9e14-4791-88e7-248eb6811c95', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026ebadc-6561-4066-8782-741b1b96b589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026ebadc-6561-4066-8782-741b1b96b589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533aa462-231e-4a93-aaf1-e7c1ef0ccf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Volume b1a81d86-9e14-4791-88e7-248eb6811c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a81d86-9e14-4791-88e7-248eb6811c95', 'volume_size': 1} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2079908223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a81d86-9e14-4791-88e7-248eb6811c95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79e2691deaf34bc5afe6850bf6e77054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:43Z,use_quota=True,user_id='ddc8b5a2b8b1452ead6a2a27320e6945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Creating volume b1a81d86-9e14-4791-88e7-248eb6811c95 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:42 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:42 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 1073741824 Sep 23 00:20:42 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:43 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 1073741824" returned: 0 in 0.814s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:43 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 Sep 23 00:20:43 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:44 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95" returned: 0 in 0.590s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533aa462-231e-4a93-aaf1-e7c1ef0ccf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a81d86-9e14-4791-88e7-248eb6811c95', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74415cb0-2dc8-4d95-8fa5-9164289cec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Volume volume-b1a81d86-9e14-4791-88e7-248eb6811c95 (b1a81d86-9e14-4791-88e7-248eb6811c95): created successfully Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74415cb0-2dc8-4d95-8fa5-9164289cec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Flow 'volume_create_manager' (9f022a6f-577d-4496-8b8a-435cfc698cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d811dd2b-0c51-423f-b8c2-cbf25e87e21a tempest-VolumesListTestJSON-791901592 None] Created volume successfully. Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Flow 'volume_create_manager' (05d16101-b492-41ef-82c9-6c38b1a56bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb532f6-4480-4e4a-a309-befc78b5d439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb532f6-4480-4e4a-a309-befc78b5d439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1920367424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d285e27-bad0-49a5-b1bb-ad906bd0fb91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79e2691deaf34bc5afe6850bf6e77054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:46Z,use_quota=True,user_id='ddc8b5a2b8b1452ead6a2a27320e6945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf528aef-b80b-4148-98da-b945b4483cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf528aef-b80b-4148-98da-b945b4483cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab4d3d1-c218-4045-8cd7-1d8780968820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab4d3d1-c218-4045-8cd7-1d8780968820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d285e27-bad0-49a5-b1bb-ad906bd0fb91', 'volume_name': 'volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b69dacc-1eaa-4418-9755-478fffc7a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b69dacc-1eaa-4418-9755-478fffc7a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6315ba7-336e-45e8-b923-fc7406e6cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:45 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Volume 2d285e27-bad0-49a5-b1bb-ad906bd0fb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91', 'volume_size': 1} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1920367424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d285e27-bad0-49a5-b1bb-ad906bd0fb91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79e2691deaf34bc5afe6850bf6e77054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:46Z,use_quota=True,user_id='ddc8b5a2b8b1452ead6a2a27320e6945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Creating volume 2d285e27-bad0-49a5-b1bb-ad906bd0fb91 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:45 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:45 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 1073741824 Sep 23 00:20:45 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:46 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 1073741824" returned: 0 in 0.790s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:46 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 Sep 23 00:20:46 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6315ba7-336e-45e8-b923-fc7406e6cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d45d8ff-6205-4d62-adc2-5b20ddb833f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Volume volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 (2d285e27-bad0-49a5-b1bb-ad906bd0fb91): created successfully Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d45d8ff-6205-4d62-adc2-5b20ddb833f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Flow 'volume_create_manager' (05d16101-b492-41ef-82c9-6c38b1a56bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8e09d9da-26cb-4943-9c82-3969ec5475ab tempest-VolumesListTestJSON-791901592 None] Created volume successfully. Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Flow 'volume_create_manager' (88e123f9-7c36-4609-8f4f-6131ab0e570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08860bb7-5db1-4de3-9624-463412d36756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08860bb7-5db1-4de3-9624-463412d36756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1638044226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c2648c-8e34-4e7a-a3ad-823d97fda4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21635a79a02f43d791e061016ba57309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:47Z,use_quota=True,user_id='3df8ecf56dd94124aca3253bb2aff770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6682bc5-7754-467f-a72e-abdfd28e1631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6682bc5-7754-467f-a72e-abdfd28e1631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454160b2-d7f5-4957-8ec9-b50bcd7d8575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454160b2-d7f5-4957-8ec9-b50bcd7d8575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c2648c-8e34-4e7a-a3ad-823d97fda4e4', 'volume_name': 'volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b82ab8-068b-46a9-a9d4-cbf2f0411d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b82ab8-068b-46a9-a9d4-cbf2f0411d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dde312-33ec-498f-8ce9-fd47adc494ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Volume 63c2648c-8e34-4e7a-a3ad-823d97fda4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4', 'volume_size': 1} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1638044226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c2648c-8e34-4e7a-a3ad-823d97fda4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21635a79a02f43d791e061016ba57309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:47Z,use_quota=True,user_id='3df8ecf56dd94124aca3253bb2aff770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Creating volume 63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:47 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:47 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 1073741824 Sep 23 00:20:47 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:48 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 1073741824" returned: 0 in 0.582s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:20:48 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:48 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.334s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dde312-33ec-498f-8ce9-fd47adc494ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89717306-e2b4-4265-996f-b54990e6af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Volume volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 (63c2648c-8e34-4e7a-a3ad-823d97fda4e4): created successfully Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89717306-e2b4-4265-996f-b54990e6af67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Flow 'volume_create_manager' (88e123f9-7c36-4609-8f4f-6131ab0e570d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-25ef10c1-606c-402e-8d08-37f48e11509b tempest-VolumesActionsTest-1759246329 None] Created volume successfully. Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Flow 'volume_create_manager' (4c1e7217-36de-459d-9802-99a3f1514c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0eadd1-827f-4428-9275-f3473e86c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0eadd1-827f-4428-9275-f3473e86c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112899874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba67e36a-11ef-49ae-b148-b23c3d2edddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79e2691deaf34bc5afe6850bf6e77054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:49Z,use_quota=True,user_id='ddc8b5a2b8b1452ead6a2a27320e6945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a754b9a3-f402-4a11-be0d-53895fddc1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a754b9a3-f402-4a11-be0d-53895fddc1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60030f91-470d-42b3-9077-dbebb5837c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60030f91-470d-42b3-9077-dbebb5837c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba67e36a-11ef-49ae-b148-b23c3d2edddc', 'volume_name': 'volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a467c1-35f2-4dbc-b0f2-72b7d037f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a467c1-35f2-4dbc-b0f2-72b7d037f01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f94f6e-133c-4639-98c9-ff2f88c54eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Volume ba67e36a-11ef-49ae-b148-b23c3d2edddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc', 'volume_size': 1} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112899874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba67e36a-11ef-49ae-b148-b23c3d2edddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79e2691deaf34bc5afe6850bf6e77054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:49Z,use_quota=True,user_id='ddc8b5a2b8b1452ead6a2a27320e6945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Creating volume ba67e36a-11ef-49ae-b148-b23c3d2edddc {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:48 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:20:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc 1073741824 Sep 23 00:20:48 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:49 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc 1073741824" returned: 0 in 0.527s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:49 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc Sep 23 00:20:49 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:49 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc" returned: 0 in 0.320s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f94f6e-133c-4639-98c9-ff2f88c54eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cecf01-bbd0-4756-9bce-ab8cf50dada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:49 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Volume volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc (ba67e36a-11ef-49ae-b148-b23c3d2edddc): created successfully Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cecf01-bbd0-4756-9bce-ab8cf50dada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Flow 'volume_create_manager' (4c1e7217-36de-459d-9802-99a3f1514c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-88d22b2e-0b24-4b99-8b9a-0a21a15a3f3c tempest-VolumesListTestJSON-791901592 None] Created volume successfully. Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:54 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:20:54 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Acquiring lock "cinder-ba67e36a-11ef-49ae-b148-b23c3d2edddc-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Lock "cinder-ba67e36a-11ef-49ae-b148-b23c3d2edddc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:55 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.515s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Acquiring lock "cinder-quobyte-ba67e36a-11ef-49ae-b148-b23c3d2edddc" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Lock "cinder-quobyte-ba67e36a-11ef-49ae-b148-b23c3d2edddc" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4f2284-bcaf-48f2-8051-70bdb5ddb327]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc Sep 23 00:20:55 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:55 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc" returned: 0 in 0.437s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc Sep 23 00:20:55 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ba67e36a-11ef-49ae-b148-b23c3d2edddc" returned: 0 in 0.378s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Lock "cinder-quobyte-ba67e36a-11ef-49ae-b148-b23c3d2edddc" released by "delete_volume" :: held 0.878s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Created reservations ['96c47b20-c562-413c-b7a2-1d33042a928d', '863820d6-a585-4124-a176-7494c4482488', 'a51c6b2f-23c2-4372-928e-6ddf18e4418e', '255dd9a9-a045-4109-916e-397bbe1b39e4', '3472784e-436b-4757-9923-1ed97a89f1e3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:56 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:20:56 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.362s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Deleted volume successfully. Sep 23 00:20:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c610b63-c4ca-4347-acd8-6cf8a59a6f3c tempest-VolumesListTestJSON-791901592 None] Lock "cinder-ba67e36a-11ef-49ae-b148-b23c3d2edddc-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Acquiring lock "cinder-2d285e27-bad0-49a5-b1bb-ad906bd0fb91-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Lock "cinder-2d285e27-bad0-49a5-b1bb-ad906bd0fb91-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Acquiring lock "cinder-quobyte-2d285e27-bad0-49a5-b1bb-ad906bd0fb91" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Lock "cinder-quobyte-2d285e27-bad0-49a5-b1bb-ad906bd0fb91" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:58 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2fafd-a470-48cb-bbb5-68f97a9abb3b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:58 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 Sep 23 00:20:58 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:58 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91" returned: 0 in 0.788s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:59 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91 Sep 23 00:20:59 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:59 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2d285e27-bad0-49a5-b1bb-ad906bd0fb91" returned: 0 in 0.617s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Lock "cinder-quobyte-2d285e27-bad0-49a5-b1bb-ad906bd0fb91" released by "delete_volume" :: held 1.517s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:59 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Created reservations ['6d3da333-91a4-4de2-bb68-4d8ac2171e58', 'a8bf694e-0baf-4ad3-b21f-c840ed8e5fb3', 'd627fcdc-114b-455d-bd0c-92ab7d99eeb3', '3341a8a7-faf5-4ad2-a579-384566fbb420', '4fed43aa-d996-4a7c-88fd-d58ab1bd4c89'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:00 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:21:00 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Acquiring lock "cinder-b1a81d86-9e14-4791-88e7-248eb6811c95-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:00 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.709s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Lock "cinder-b1a81d86-9e14-4791-88e7-248eb6811c95-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Deleted volume successfully. Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0df8fda9-f2f4-4765-8bee-7456ea281e0d tempest-VolumesListTestJSON-791901592 None] Lock "cinder-2d285e27-bad0-49a5-b1bb-ad906bd0fb91-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Acquiring lock "cinder-quobyte-b1a81d86-9e14-4791-88e7-248eb6811c95" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Lock "cinder-quobyte-b1a81d86-9e14-4791-88e7-248eb6811c95" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[228a2eff-23e7-4cc8-83f3-34f202952c22]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 Sep 23 00:21:01 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:01 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95" returned: 0 in 0.555s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95 Sep 23 00:21:01 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3d904ab6-8799-43d3-967d-fa3a2f43d57e tempest-VolumesActionsTest-1759246329 None] Acquiring lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" by "attach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3d904ab6-8799-43d3-967d-fa3a2f43d57e tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" acquired by "attach_volume" :: waited 0.054s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3d904ab6-8799-43d3-967d-fa3a2f43d57e tempest-VolumesActionsTest-1759246329 None] Attaching volume 63c2648c-8e34-4e7a-a3ad-823d97fda4e4 to instance 8d0056a2-ec89-4bb9-9b3f-d47b31232d22 at mountpoint /dev/vdb on host None. Sep 23 00:21:02 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3d904ab6-8799-43d3-967d-fa3a2f43d57e tempest-VolumesActionsTest-1759246329 None] Attach volume completed successfully. Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b1a81d86-9e14-4791-88e7-248eb6811c95" returned: 0 in 0.617s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3d904ab6-8799-43d3-967d-fa3a2f43d57e tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" released by "attach_volume" :: held 0.327s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Lock "cinder-quobyte-b1a81d86-9e14-4791-88e7-248eb6811c95" released by "delete_volume" :: held 1.252s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Created reservations ['e25b8908-3886-4898-8f61-00056e936ecb', '5badaf50-bba0-48ca-b3a6-dfdd6990681e', '7971ac4d-4da2-4591-98ae-2be23aeb15ec', 'b1da6333-fb8a-4899-8864-ceccb1ec7e2c', '904dc6d9-08a0-47e5-ac66-b7355529d05a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2e5043bc-6740-489f-8a7c-94db11a0f4fe tempest-VolumesActionsTest-1759246329 None] Acquiring lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-detach_volume" by "detach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:02 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:21:02 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2e5043bc-6740-489f-8a7c-94db11a0f4fe tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2e5043bc-6740-489f-8a7c-94db11a0f4fe tempest-VolumesActionsTest-1759246329 None] Detaching volume 63c2648c-8e34-4e7a-a3ad-823d97fda4e4 from instance 8d0056a2-ec89-4bb9-9b3f-d47b31232d22. Sep 23 00:21:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2e5043bc-6740-489f-8a7c-94db11a0f4fe tempest-VolumesActionsTest-1759246329 None] Detach volume completed successfully. Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2e5043bc-6740-489f-8a7c-94db11a0f4fe tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:02 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.533s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Deleted volume successfully. Sep 23 00:21:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f477561b-22cb-41ec-a19e-604119b3fe8a tempest-VolumesListTestJSON-791901592 None] Lock "cinder-b1a81d86-9e14-4791-88e7-248eb6811c95-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-2c895289-da8b-426c-b079-665be8350234 req-7afa4372-a3fa-40bb-af5f-dd39cd04b87a tempest-AttachVolumeTestJSON-1628138625 None] Terminate volume connection completed successfully. Sep 23 00:21:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-2c895289-da8b-426c-b079-665be8350234 req-7afa4372-a3fa-40bb-af5f-dd39cd04b87a tempest-AttachVolumeTestJSON-1628138625 None] Deleting attachment 235bcbb6-d72b-41c2-8fd2-dda8b400da5a. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:12 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=57,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:19 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=53,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:24 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-46360d6c-366c-4b89-81c0-cf6dc383880f tempest-VolumesActionsTest-1759246329 None] Acquiring lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" by "attach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:24 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-46360d6c-366c-4b89-81c0-cf6dc383880f tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" acquired by "attach_volume" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:24 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-46360d6c-366c-4b89-81c0-cf6dc383880f tempest-VolumesActionsTest-1759246329 None] Attaching volume 63c2648c-8e34-4e7a-a3ad-823d97fda4e4 to instance 2b0a023f-2612-4306-a1de-4dd646cc2fd5 at mountpoint /dev/vdb on host None. Sep 23 00:21:24 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-46360d6c-366c-4b89-81c0-cf6dc383880f tempest-VolumesActionsTest-1759246329 None] Attach volume completed successfully. Sep 23 00:21:24 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-46360d6c-366c-4b89-81c0-cf6dc383880f tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" released by "attach_volume" :: held 0.223s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6ce4e7cd-3536-4e39-83b9-b6f3b71a0389 tempest-VolumesActionsTest-1759246329 None] Acquiring lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-detach_volume" by "detach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6ce4e7cd-3536-4e39-83b9-b6f3b71a0389 tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6ce4e7cd-3536-4e39-83b9-b6f3b71a0389 tempest-VolumesActionsTest-1759246329 None] Detaching volume 63c2648c-8e34-4e7a-a3ad-823d97fda4e4 from instance 2b0a023f-2612-4306-a1de-4dd646cc2fd5. Sep 23 00:21:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6ce4e7cd-3536-4e39-83b9-b6f3b71a0389 tempest-VolumesActionsTest-1759246329 None] Detach volume completed successfully. Sep 23 00:21:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6ce4e7cd-3536-4e39-83b9-b6f3b71a0389 tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3d4c7-64a8-4b4d-b402-dfbbc9dd60c7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:33 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:21:33 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:33 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.712s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:33 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3fec2c-26e7-4eba-ac88-e0a5f628dcc2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:33 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:21:33 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:33 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Flow 'volume_create_manager' (5713d353-dcc1-4790-9f5d-3f1fbdc3c0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476817a4-367f-42da-9e81-0a5003fed4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476817a4-367f-42da-9e81-0a5003fed4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-727677373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a22f2e-8d52-44d3-b549-5aa09975c9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c020f27bfd42d4a797e60e2bd94734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:34Z,use_quota=True,user_id='ba69648324d742cd96f26955462f1e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2e3637-82b9-425a-8ca1-0db7ff7b1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2e3637-82b9-425a-8ca1-0db7ff7b1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae0c4cb-9518-4b47-8b95-d7bf74f90d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae0c4cb-9518-4b47-8b95-d7bf74f90d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a22f2e-8d52-44d3-b549-5aa09975c9fb', 'volume_name': 'volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a28151-af21-4d26-bb89-99e8cbd6eb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a28151-af21-4d26-bb89-99e8cbd6eb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1932793f-1e2c-4b76-9c01-7b591037a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Volume 86a22f2e-8d52-44d3-b549-5aa09975c9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb', 'volume_size': 1} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:34 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.537s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.40a41f18-ffa8-4ff9-8657-556f81ec6dafnxv14w4t.img {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:34 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.40a41f18-ffa8-4ff9-8657-556f81ec6dafnxv14w4t.img Sep 23 00:21:34 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.40a41f18-ffa8-4ff9-8657-556f81ec6dafnxv14w4t.img" returned: 0 in 8.350s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b1beb-dc24-4937-9e1b-84a13401156a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:21:42 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:43 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.741s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:43 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.40a41f18-ffa8-4ff9-8657-556f81ec6dafnxv14w4t.img {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:21:43 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Converted 1024.00 MB image at 122.62 MB/s Sep 23 00:21:43 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] 40a41f18-ffa8-4ff9-8657-556f81ec6daf was raw, no need to convert to raw {{(pid=87292) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:21:44 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:53 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:54 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:21:54 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:55 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.561s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:21:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Flow 'volume_create_manager' (439a4e8a-f319-44f6-9a2d-95072b5aab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ceaea9-7b65-4940-af30-540d570bc945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ceaea9-7b65-4940-af30-540d570bc945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1225561964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64608054-6464-4eca-9dce-8bf3f62e967b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3d3de0a0842ceb4b67737f29e9b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:59Z,use_quota=True,user_id='742b6a68a9ba42da831b1fff4e1ee533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(426fbf5b-b47e-4ece-a1ff-749583bdc02e),volume_type_id=426fbf5b-b47e-4ece-a1ff-749583bdc02e)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4384b0-5126-48a4-91dc-fb5ca5018aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4384b0-5126-48a4-91dc-fb5ca5018aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc3edda-14c5-4e7b-b920-e95c4ba3b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc3edda-14c5-4e7b-b920-e95c4ba3b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64608054-6464-4eca-9dce-8bf3f62e967b', 'volume_name': 'volume-64608054-6464-4eca-9dce-8bf3f62e967b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a5544e-70d9-4480-87c2-f5f348ef0595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a5544e-70d9-4480-87c2-f5f348ef0595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8270fa-06b6-48ee-bf3f-b3fd5f44ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Volume 64608054-6464-4eca-9dce-8bf3f62e967b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64608054-6464-4eca-9dce-8bf3f62e967b', 'volume_size': 1} Sep 23 00:21:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Flow 'volume_create_manager' (2e38daf8-7b6f-4f59-a182-09d7c29ef9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae12a709-906e-4fff-8a38-1e22dc0ea128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae12a709-906e-4fff-8a38-1e22dc0ea128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-302996660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5222632-fdbd-4294-86cd-b63af9f0acd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3d3de0a0842ceb4b67737f29e9b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:00Z,use_quota=True,user_id='742b6a68a9ba42da831b1fff4e1ee533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a51cbf9b-053d-41ac-b241-465dfc661ee1),volume_type_id=a51cbf9b-053d-41ac-b241-465dfc661ee1)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a665e3-b006-4a32-9ced-d0d98dd962a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a665e3-b006-4a32-9ced-d0d98dd962a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5a5ea2-e861-42fc-b8b0-a197f5db0efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5a5ea2-e861-42fc-b8b0-a197f5db0efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5222632-fdbd-4294-86cd-b63af9f0acd7', 'volume_name': 'volume-f5222632-fdbd-4294-86cd-b63af9f0acd7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56d770a-faee-4c2a-bc53-105fe4669451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56d770a-faee-4c2a-bc53-105fe4669451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a02207-54a6-4121-837c-0ebfc043f5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Volume f5222632-fdbd-4294-86cd-b63af9f0acd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5222632-fdbd-4294-86cd-b63af9f0acd7', 'volume_size': 1} Sep 23 00:22:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Flow 'volume_create_manager' (e0f2d36b-b0ca-45cd-893c-92c7d59aa22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09099145-9aec-493f-98b8-25b0f574a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09099145-9aec-493f-98b8-25b0f574a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-64796978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627c5d3e-e71f-41e3-87a6-d926e7c1cd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3d3de0a0842ceb4b67737f29e9b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:01Z,use_quota=True,user_id='742b6a68a9ba42da831b1fff4e1ee533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cf3a1d-0a5c-4380-89a9-776afecd6e80),volume_type_id=76cf3a1d-0a5c-4380-89a9-776afecd6e80)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d40d4b-1655-4d1a-8117-1af6a2f43260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d40d4b-1655-4d1a-8117-1af6a2f43260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711b2d1a-0037-4869-a0c8-cfe2f466a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711b2d1a-0037-4869-a0c8-cfe2f466a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '627c5d3e-e71f-41e3-87a6-d926e7c1cd18', 'volume_name': 'volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18', 'volume_size': 1, 'image_id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43320884-d164-4cdb-995d-0fb621de0fa8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--170749908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18b3d3de0a0842ceb4b67737f29e9b9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'created_at': datetime.datetime(2026, 9, 22, 22, 21, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43320884-d164-4cdb-995d-0fb621de0fa8/file', 'properties': {}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0771755-bd46-49ad-a69a-c234c137665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0771755-bd46-49ad-a69a-c234c137665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfea49a-0220-4102-80bd-37dbe386d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Volume 627c5d3e-e71f-41e3-87a6-d926e7c1cd18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18', 'volume_size': 1, 'image_id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43320884-d164-4cdb-995d-0fb621de0fa8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--170749908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18b3d3de0a0842ceb4b67737f29e9b9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'created_at': datetime.datetime(2026, 9, 22, 22, 21, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43320884-d164-4cdb-995d-0fb621de0fa8/file', 'properties': {}}, 'image_service': } Sep 23 00:22:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Trying to clone 627c5d3e-e71f-41e3-87a6-d926e7c1cd18 from image 43320884-d164-4cdb-995d-0fb621de0fa8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43320884-d164-4cdb-995d-0fb621de0fa8', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:22:07 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD, size 20.69 MB, duration 5.64 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:22:07 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Image download 20.69 MB at 3.67 MB/s Sep 23 00:22:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf0d362-d716-4ada-9da3-1815a7b4aa3f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD Sep 23 00:22:07 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Temporary image 43320884-d164-4cdb-995d-0fb621de0fa8 is fetched for user 742b6a68a9ba42da831b1fff4e1ee533. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:22:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3c322-270a-4f64-a14b-8452ac882cc3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD Sep 23 00:22:08 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Uploaded volume to glance image-id: 40a41f18-ffa8-4ff9-8657-556f81ec6daf. {{(pid=87292) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 40.716s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-727677373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a22f2e-8d52-44d3-b549-5aa09975c9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c020f27bfd42d4a797e60e2bd94734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:34Z,use_quota=True,user_id='ba69648324d742cd96f26955462f1e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Creating volume 86a22f2e-8d52-44d3-b549-5aa09975c9fb {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:14 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:22:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb 1073741824 Sep 23 00:22:14 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d6e4e554-9dd3-4fcf-8027-fbd3623742a8 tempest-VolumesActionsTest-1759246329 None] Copy volume to image completed successfully. Sep 23 00:22:15 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb 1073741824" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb Sep 23 00:22:15 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb" returned: 0 in 0.308s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.116s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1225561964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64608054-6464-4eca-9dce-8bf3f62e967b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3d3de0a0842ceb4b67737f29e9b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:59Z,use_quota=True,user_id='742b6a68a9ba42da831b1fff4e1ee533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(426fbf5b-b47e-4ece-a1ff-749583bdc02e),volume_type_id=426fbf5b-b47e-4ece-a1ff-749583bdc02e)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Creating volume 64608054-6464-4eca-9dce-8bf3f62e967b {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:15 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1932793f-1e2c-4b76-9c01-7b591037a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b 1073741824 Sep 23 00:22:15 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d684063-9a48-488b-92fb-a72fba73b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Volume volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb (86a22f2e-8d52-44d3-b549-5aa09975c9fb): created successfully Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d684063-9a48-488b-92fb-a72fba73b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Flow 'volume_create_manager' (5713d353-dcc1-4790-9f5d-3f1fbdc3c0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3205a25d-90a6-44e1-bb47-8c1ffca3b2ad tempest-AttachVolumeNegativeTest-2066461253 None] Created volume successfully. Sep 23 00:22:16 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b 1073741824" returned: 0 in 0.673s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b Sep 23 00:22:16 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b" returned: 0 in 0.355s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.515s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-302996660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5222632-fdbd-4294-86cd-b63af9f0acd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3d3de0a0842ceb4b67737f29e9b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:00Z,use_quota=True,user_id='742b6a68a9ba42da831b1fff4e1ee533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a51cbf9b-053d-41ac-b241-465dfc661ee1),volume_type_id=a51cbf9b-053d-41ac-b241-465dfc661ee1)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Creating volume f5222632-fdbd-4294-86cd-b63af9f0acd7 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:16 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8270fa-06b6-48ee-bf3f-b3fd5f44ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64608054-6464-4eca-9dce-8bf3f62e967b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61daa75c-074b-4def-8d40-9571d4be080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:16 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 1073741824 Sep 23 00:22:16 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:17 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Volume volume-64608054-6464-4eca-9dce-8bf3f62e967b (64608054-6464-4eca-9dce-8bf3f62e967b): created successfully Sep 23 00:22:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61daa75c-074b-4def-8d40-9571d4be080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Flow 'volume_create_manager' (439a4e8a-f319-44f6-9a2d-95072b5aab7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b1d2c182-91a4-482f-a00e-b15d6be93a3c tempest-TestInstancesWithCinderVolumes-274778151 None] Created volume successfully. Sep 23 00:22:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:17 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 1073741824" returned: 0 in 0.777s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:17 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 Sep 23 00:22:17 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-c34c800a-e3bb-4944-9a3b-9f9cddce7c55 req-3cae3fc0-6c81-4b4a-b9cb-af63ac30dd61 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:18 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7" returned: 0 in 0.366s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.892s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-64796978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627c5d3e-e71f-41e3-87a6-d926e7c1cd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3d3de0a0842ceb4b67737f29e9b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:01Z,use_quota=True,user_id='742b6a68a9ba42da831b1fff4e1ee533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cf3a1d-0a5c-4380-89a9-776afecd6e80),volume_type_id=76cf3a1d-0a5c-4380-89a9-776afecd6e80)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Creating volume 627c5d3e-e71f-41e3-87a6-d926e7c1cd18 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:18 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a02207-54a6-4121-837c-0ebfc043f5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5222632-fdbd-4294-86cd-b63af9f0acd7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 1073741824 Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88bb057-ed67-42aa-b1fa-c5a1830ecf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Volume volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 (f5222632-fdbd-4294-86cd-b63af9f0acd7): created successfully Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88bb057-ed67-42aa-b1fa-c5a1830ecf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Flow 'volume_create_manager' (2e38daf8-7b6f-4f59-a182-09d7c29ef9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d802b9ea-7e73-4951-a834-edc36a878a9e tempest-TestInstancesWithCinderVolumes-274778151 None] Created volume successfully. Sep 23 00:22:18 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 1073741824" returned: 0 in 0.514s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 Sep 23 00:22:18 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" returned: 0 in 0.307s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.479s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b77a0-35ef-4d7b-8ac7-8e690e0be8e0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Attempting download of 43320884-d164-4cdb-995d-0fb621de0fa8 ((None, [{'url': 'file:///opt/stack/data/glance/images/43320884-d164-4cdb-995d-0fb621de0fa8', 'metadata': {}}])) to volume 627c5d3e-e71f-41e3-87a6-d926e7c1cd18. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f6dfdc-0144-4b4d-9f0a-ba42609b9972]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:22:19 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75 Sep 23 00:22:19 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ba8ee-1279-489a-9ba3-4f10730927fd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:22:19 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75" returned: 0 in 0.490s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75 Sep 23 00:22:19 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img Sep 23 00:22:19 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75" returned: 1 in 0.478s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43320884-d164-4cdb-995d-0fb621de0fa8_j0i_rc75' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ff3b5-1cea-4f15-b2ba-7f0d8570942e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD Sep 23 00:22:20 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] 43320884-d164-4cdb-995d-0fb621de0fa8 was qcow2, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:22:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 Sep 23 00:22:20 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:27 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" returned: 0 in 6.693s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:27 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43320884-d164-4cdb-995d-0fb621de0fa8_yp9wmui4devstack@QuobyteHD, size 112.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:22:27 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Converted 112.00 MB image at 16.73 MB/s Sep 23 00:22:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:27 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 1G Sep 23 00:22:27 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:28 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 1G" returned: 0 in 0.783s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Downloaded image 43320884-d164-4cdb-995d-0fb621de0fa8 ((None, [{'url': 'file:///opt/stack/data/glance/images/43320884-d164-4cdb-995d-0fb621de0fa8', 'metadata': {}}])) to volume 627c5d3e-e71f-41e3-87a6-d926e7c1cd18 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Temporary image 43320884-d164-4cdb-995d-0fb621de0fa8 for user 742b6a68a9ba42da831b1fff4e1ee533 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Marking volume 627c5d3e-e71f-41e3-87a6-d926e7c1cd18 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Copying metadata from image 43320884-d164-4cdb-995d-0fb621de0fa8 to 627c5d3e-e71f-41e3-87a6-d926e7c1cd18. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Creating volume glance metadata for volume 627c5d3e-e71f-41e3-87a6-d926e7c1cd18 backed by image 43320884-d164-4cdb-995d-0fb621de0fa8 with: {'image_id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'image_name': 'tempest-scenario-img--170749908', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfea49a-0220-4102-80bd-37dbe386d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18', 'volume_size': 1, 'image_id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43320884-d164-4cdb-995d-0fb621de0fa8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--170749908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18b3d3de0a0842ceb4b67737f29e9b9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43320884-d164-4cdb-995d-0fb621de0fa8', 'created_at': datetime.datetime(2026, 9, 22, 22, 21, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43320884-d164-4cdb-995d-0fb621de0fa8/file', 'properties': {}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1330ec74-f4b5-495d-a0b1-40d3a243cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:28 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Volume volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 (627c5d3e-e71f-41e3-87a6-d926e7c1cd18): created successfully Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1330ec74-f4b5-495d-a0b1-40d3a243cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Flow 'volume_create_manager' (e0f2d36b-b0ca-45cd-893c-92c7d59aa22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:28 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-850edb95-a301-4894-928b-78b8f5d3b0be tempest-TestInstancesWithCinderVolumes-274778151 None] Created volume successfully. Sep 23 00:22:28 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img" returned: 0 in 9.044s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[99829918-5a9c-4b1c-bdcf-5115efd53638]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:29 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:22:29 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:29 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.614s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:22:29 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Converted 1024.00 MB image at 113.22 MB/s Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] a25da0e7-e351-41bf-8b41-f44f702626da was raw, converting to qcow2 {{(pid=87292) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe91af8-b8e9-4d3b-8986-7eaaeb0381d2]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:29 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img Sep 23 00:22:29 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:30 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img" returned: 0 in 0.394s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:30 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img Sep 23 00:22:30 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:30 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img" returned: 1 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:30 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0 Sep 23 00:22:30 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:30 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0" returned: 0 in 0.325s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Image conversion details: src /opt/stack/data/cinder/conversion/63c2648c-8e34-4e7a-a3ad-823d97fda4e4.temp_image.a25da0e7-e351-41bf-8b41-f44f702626danknr36xl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:22:30 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0e833-6d92-4f87-9286-0a10d93c3184]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:30 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0 Sep 23 00:22:30 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:31 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6gce8jb0" returned: 0 in 0.420s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-18504d09-1a77-4faa-bcf1-0db51dde85ce req-35fb6fbf-c927-42ab-a2fb-29c5d7afa70d tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.521s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Uploaded volume to glance image-id: a25da0e7-e351-41bf-8b41-f44f702626da. {{(pid=87292) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-c34c800a-e3bb-4944-9a3b-9f9cddce7c55 req-3cae3fc0-6c81-4b4a-b9cb-af63ac30dd61 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.417s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-c34c800a-e3bb-4944-9a3b-9f9cddce7c55 req-3cae3fc0-6c81-4b4a-b9cb-af63ac30dd61 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-18504d09-1a77-4faa-bcf1-0db51dde85ce req-35fb6fbf-c927-42ab-a2fb-29c5d7afa70d tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.482s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6f00c3f0-15e1-4302-a460-299741421a04 tempest-VolumesActionsTest-1759246329 None] Copy volume to image completed successfully. Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-18504d09-1a77-4faa-bcf1-0db51dde85ce req-35fb6fbf-c927-42ab-a2fb-29c5d7afa70d tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.098s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-c34c800a-e3bb-4944-9a3b-9f9cddce7c55 req-3cae3fc0-6c81-4b4a-b9cb-af63ac30dd61 tempest-AttachVolumeNegativeTest-2066461253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba2db47f-e213-4b31-8f27-d9f662edc759', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-18504d09-1a77-4faa-bcf1-0db51dde85ce req-35fb6fbf-c927-42ab-a2fb-29c5d7afa70d tempest-TestInstancesWithCinderVolumes-274778151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0edca58-8037-450a-8f5a-f90b50599032', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-c34c800a-e3bb-4944-9a3b-9f9cddce7c55 req-3cae3fc0-6c81-4b4a-b9cb-af63ac30dd61 tempest-AttachVolumeNegativeTest-2066461253 None] attachment_update completed successfully. Sep 23 00:22:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-18504d09-1a77-4faa-bcf1-0db51dde85ce req-35fb6fbf-c927-42ab-a2fb-29c5d7afa70d tempest-TestInstancesWithCinderVolumes-274778151 None] attachment_update completed successfully. Sep 23 00:22:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Acquiring lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Acquiring lock "cinder-quobyte-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Lock "cinder-quobyte-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6d9e48-43cb-4e66-9664-8ad57fa9623a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:35 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:22:35 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:35 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.698s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:35 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4 Sep 23 00:22:35 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Flow 'volume_create_manager' (ad7eaa4c-20d7-48ff-88a8-d5002a4bc3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253a8b98-30e0-4459-8529-18c12c3ef98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253a8b98-30e0-4459-8529-18c12c3ef98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-197766754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e9e56c-a276-4160-ab53-d2af2693b4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4e89b317bb4205817ec42c99637ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:36Z,use_quota=True,user_id='c3459e9d1941433892d7fcaca78e3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c33e79-2f87-41c1-a15d-6575164d8c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c33e79-2f87-41c1-a15d-6575164d8c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23769144-f34e-4a07-9785-2e2e47ef7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23769144-f34e-4a07-9785-2e2e47ef7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e9e56c-a276-4160-ab53-d2af2693b4e8', 'volume_name': 'volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ce389-b779-4088-9a2b-c555ff550a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ce389-b779-4088-9a2b-c555ff550a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18d7a58-8938-4ca2-b7e0-a3f132a0a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:36 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Volume d5e9e56c-a276-4160-ab53-d2af2693b4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8', 'volume_size': 1} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-197766754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e9e56c-a276-4160-ab53-d2af2693b4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4e89b317bb4205817ec42c99637ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:36Z,use_quota=True,user_id='c3459e9d1941433892d7fcaca78e3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Creating volume d5e9e56c-a276-4160-ab53-d2af2693b4e8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:36 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:36 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 1073741824 Sep 23 00:22:36 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:36 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" returned: 0 in 0.562s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Lock "cinder-quobyte-63c2648c-8e34-4e7a-a3ad-823d97fda4e4" released by "delete_volume" :: held 1.320s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Created reservations ['7dcadea0-79e9-4524-bebe-ebf0765cf51e', '74f5923a-2fb6-45a5-9032-50c7b7cf54e0', 'd4688b93-28d5-4a6a-a5b5-f07933d2fc9a', 'bc563296-648b-40eb-8b88-b1816830dd6c', '15837d05-bada-423f-9a8b-867d12feb882'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-2f5874dd-40ff-4aa0-8b48-b35aa8574384 req-0218b2d0-43c4-4cc2-b688-7ecd5af58bc0 tempest-AttachVolumeNegativeTest-2066461253 None] Terminate volume connection completed successfully. Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-2f5874dd-40ff-4aa0-8b48-b35aa8574384 req-0218b2d0-43c4-4cc2-b688-7ecd5af58bc0 tempest-AttachVolumeNegativeTest-2066461253 None] Deleting attachment ba2db47f-e213-4b31-8f27-d9f662edc759. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:36 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:22:36 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:36 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 1073741824" returned: 0 in 0.785s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:36 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 Sep 23 00:22:36 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:37 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.422s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Deleted volume successfully. Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f7f8119-83ff-4c8d-9458-5e8da1474c37 tempest-VolumesActionsTest-1759246329 None] Lock "cinder-63c2648c-8e34-4e7a-a3ad-823d97fda4e4-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:37 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8" returned: 0 in 0.464s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18d7a58-8938-4ca2-b7e0-a3f132a0a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cdb8c8-0222-4207-9349-77297fc58a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Volume volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 (d5e9e56c-a276-4160-ab53-d2af2693b4e8): created successfully Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cdb8c8-0222-4207-9349-77297fc58a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Flow 'volume_create_manager' (ad7eaa4c-20d7-48ff-88a8-d5002a4bc3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a59aea57-7a3a-4eca-8771-0ce06b59a863 tempest-AttachVolumeTestJSON-1628138625 None] Created volume successfully. Sep 23 00:22:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-afbf4a86-31d9-47ea-84fa-2e2df7b4267f req-d9ab28dc-4e5d-458d-9797-b3cfbd61047e tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-afbf4a86-31d9-47ea-84fa-2e2df7b4267f req-d9ab28dc-4e5d-458d-9797-b3cfbd61047e tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-afbf4a86-31d9-47ea-84fa-2e2df7b4267f req-d9ab28dc-4e5d-458d-9797-b3cfbd61047e tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-afbf4a86-31d9-47ea-84fa-2e2df7b4267f req-d9ab28dc-4e5d-458d-9797-b3cfbd61047e tempest-AttachVolumeTestJSON-1628138625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfb126e4-8b54-43ad-90b8-bd26b0cd4513', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-afbf4a86-31d9-47ea-84fa-2e2df7b4267f req-d9ab28dc-4e5d-458d-9797-b3cfbd61047e tempest-AttachVolumeTestJSON-1628138625 None] attachment_update completed successfully. Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Flow 'volume_create_manager' (d5a9e4e1-a472-4484-a935-b973a83632ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86df2319-4797-4556-88e0-65b41dc40d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86df2319-4797-4556-88e0-65b41dc40d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1117309999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4e89b317bb4205817ec42c99637ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:44Z,use_quota=True,user_id='c3459e9d1941433892d7fcaca78e3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35516ac1-1fb2-44c2-88b9-39cf46523668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35516ac1-1fb2-44c2-88b9-39cf46523668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c361700c-ba29-4cb0-9c21-81ce91c7278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c361700c-ba29-4cb0-9c21-81ce91c7278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0', 'volume_name': 'volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50338122-0a50-46c6-adc1-e8c498d3a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50338122-0a50-46c6-adc1-e8c498d3a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663b8087-0439-491d-b0b7-838638400ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Volume 282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0', 'volume_size': 1} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1117309999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4e89b317bb4205817ec42c99637ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:44Z,use_quota=True,user_id='c3459e9d1941433892d7fcaca78e3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Creating volume 282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:44 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 1073741824 Sep 23 00:22:44 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 1073741824" returned: 0 in 0.808s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:45 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 Sep 23 00:22:45 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:45 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0" returned: 0 in 0.499s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663b8087-0439-491d-b0b7-838638400ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f986399-6b2d-464a-ae47-8a43145f409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:45 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Volume volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 (282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0): created successfully Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f986399-6b2d-464a-ae47-8a43145f409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Flow 'volume_create_manager' (d5a9e4e1-a472-4484-a935-b973a83632ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:45 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-881e927e-e45c-48fc-acb7-bfd9178622e2 tempest-AttachVolumeTestJSON-1628138625 None] Created volume successfully. Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "cinder-86a22f2e-8d52-44d3-b549-5aa09975c9fb-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-86a22f2e-8d52-44d3-b549-5aa09975c9fb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "cinder-quobyte-86a22f2e-8d52-44d3-b549-5aa09975c9fb" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-quobyte-86a22f2e-8d52-44d3-b549-5aa09975c9fb" acquired by "delete_volume" :: waited 0.051s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b571cf02-2db9-41b6-b635-b77124bba15d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb Sep 23 00:22:46 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb" returned: 0 in 1.039s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:47 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb Sep 23 00:22:47 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-bb208aa9-ae49-4b06-bd4f-d8d5e9916663 req-8a28a912-021f-470e-8dcd-5018684c730e tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-bb208aa9-ae49-4b06-bd4f-d8d5e9916663 req-8a28a912-021f-470e-8dcd-5018684c730e tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:48 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86a22f2e-8d52-44d3-b549-5aa09975c9fb" returned: 0 in 0.759s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-bb208aa9-ae49-4b06-bd4f-d8d5e9916663 req-8a28a912-021f-470e-8dcd-5018684c730e tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.117s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-quobyte-86a22f2e-8d52-44d3-b549-5aa09975c9fb" released by "delete_volume" :: held 1.947s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-bb208aa9-ae49-4b06-bd4f-d8d5e9916663 req-8a28a912-021f-470e-8dcd-5018684c730e tempest-AttachVolumeTestJSON-1628138625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bdc4505-3583-4fef-9614-b538a8c9e21f', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Created reservations ['0bc1baff-4e42-4e2e-a12a-cf77abbc23ef', '890b2a7b-f69a-4c96-abbf-9a7543803d11', 'd717fb61-b019-4235-b8f2-63013fb05c9e', '535b5f6b-f4e6-4cc5-8f94-d069cf2bcd8c', 'a393ed6a-c284-4b27-9361-b8b9437a5190'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-bb208aa9-ae49-4b06-bd4f-d8d5e9916663 req-8a28a912-021f-470e-8dcd-5018684c730e tempest-AttachVolumeTestJSON-1628138625 None] attachment_update completed successfully. Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:48 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:22:48 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "cinder-86726322-ce96-456d-961e-60875930dbfd-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-86726322-ce96-456d-961e-60875930dbfd-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:49 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "cinder-quobyte-86726322-ce96-456d-961e-60875930dbfd" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.706s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Deleted volume successfully. Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-quobyte-86726322-ce96-456d-961e-60875930dbfd" acquired by "delete_volume" :: waited 0.043s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1d66541b-7a36-43ba-b8bb-f84934230723 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-86a22f2e-8d52-44d3-b549-5aa09975c9fb-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceb8e0b-2b7b-4aea-bae8-a6e74f60fbba]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:49 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd Sep 23 00:22:49 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:50 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd" returned: 0 in 0.775s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:50 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd Sep 23 00:22:50 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:50 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-86726322-ce96-456d-961e-60875930dbfd" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-quobyte-86726322-ce96-456d-961e-60875930dbfd" released by "delete_volume" :: held 1.245s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Created reservations ['fdd0564f-3039-43b0-8631-2373f9aa81c3', 'b98eb1bd-c35d-44bb-88df-d7b85ec48d7d', 'b2327d7e-36ac-4d9b-b0a8-c09f300e91e5', 'cd959d04-f441-4441-8c6e-481b04db6bb6', 'ae2d2b3b-4274-4ae1-91df-3859a6d0adb3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:50 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:22:50 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:51 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.420s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:51 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Deleted volume successfully. Sep 23 00:22:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a2c53c49-2479-41f7-bb91-c31bd2ea123e tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-86726322-ce96-456d-961e-60875930dbfd-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "cinder-fb1f6516-f702-4a22-b098-48dd3f9ae68d-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-fb1f6516-f702-4a22-b098-48dd3f9ae68d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "cinder-quobyte-fb1f6516-f702-4a22-b098-48dd3f9ae68d" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-quobyte-fb1f6516-f702-4a22-b098-48dd3f9ae68d" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c387103-e73a-4f6a-a01f-16c2f70b996f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:52 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d Sep 23 00:22:52 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-b536223a-d366-4746-aa80-ab8d795fccbf req-15e01e95-6ec2-43dc-9cce-e094fb886300 tempest-AttachVolumeTestJSON-1628138625 None] Terminate volume connection completed successfully. Sep 23 00:22:52 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-b536223a-d366-4746-aa80-ab8d795fccbf req-15e01e95-6ec2-43dc-9cce-e094fb886300 tempest-AttachVolumeTestJSON-1628138625 None] Deleting attachment cfb126e4-8b54-43ad-90b8-bd26b0cd4513. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:53 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d" returned: 0 in 0.956s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:53 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d Sep 23 00:22:53 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:53 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1f6516-f702-4a22-b098-48dd3f9ae68d" returned: 0 in 0.550s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-quobyte-fb1f6516-f702-4a22-b098-48dd3f9ae68d" released by "delete_volume" :: held 1.617s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:53 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=65,cinder:UPDATE=52,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:53 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Created reservations ['fb6d4256-4682-4b36-8a8a-d5b5841ae03e', '7c951d2f-6eeb-4ba7-ae07-0ff16cf53709', '6582d440-409d-43c1-b6fb-f4030a8aec06', 'fafd7089-47df-4fd0-bb95-bd5f08750a48', '18be67c9-fcdc-4a71-aab8-ce24cf4520e2'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:54 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:22:54 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:54 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.631s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Deleted volume successfully. Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=76,cinder:UPDATE=65,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-367e0ba1-d4dc-4ff5-bfc7-dca464856cb7 tempest-AttachVolumeNegativeTest-2066461253 None] Lock "cinder-fb1f6516-f702-4a22-b098-48dd3f9ae68d-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:54 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:22:54 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:55 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-7755b282-bfe8-4487-b452-3fbad21f01b9 req-3ee9e1b8-2819-4408-abb2-12bba1011ff8 tempest-AttachVolumeTestJSON-1628138625 None] Terminate volume connection completed successfully. Sep 23 00:22:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7755b282-bfe8-4487-b452-3fbad21f01b9 req-3ee9e1b8-2819-4408-abb2-12bba1011ff8 tempest-AttachVolumeTestJSON-1628138625 None] Deleting attachment 2bdc4505-3583-4fef-9614-b538a8c9e21f. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:55 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.898s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:22:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:05 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:05 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "cinder-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "cinder-quobyte-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-quobyte-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2803af-b203-4a3c-a8fe-7b2ca0636fe7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:08 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 Sep 23 00:23:08 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:09 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0" returned: 0 in 0.619s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:09 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0 Sep 23 00:23:09 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:09 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0" returned: 0 in 0.394s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-quobyte-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0" released by "delete_volume" :: held 1.093s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:09 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Created reservations ['784df6ee-b0df-4fff-8121-e0dbb1f6981d', '01e392b7-1f76-43b1-bae9-a4499a5cbaf3', 'faca5ace-cea8-4f57-be2c-631fc4444b53', '37c1d468-01e1-4fbb-a079-0dded845c0b3', 'cc143c41-6b91-4b33-a68f-0fc2acef5560'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:10 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:10 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:10 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.366s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Deleted volume successfully. Sep 23 00:23:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e986ba36-ca8d-418c-849f-09cf3774e1af tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-282cadd0-fcf3-472d-80cf-b6f0d0b2f6d0-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "cinder-d5e9e56c-a276-4160-ab53-d2af2693b4e8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-d5e9e56c-a276-4160-ab53-d2af2693b4e8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "cinder-quobyte-d5e9e56c-a276-4160-ab53-d2af2693b4e8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-quobyte-d5e9e56c-a276-4160-ab53-d2af2693b4e8" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e8ed6d-b293-42bf-9068-64cb30849ffb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:11 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 Sep 23 00:23:11 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Flow 'volume_create_manager' (970f0870-bb68-40a0-8646-cbabe0fbe31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b65b7a0-98ea-4fc7-b8e9-dffcf917be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b65b7a0-98ea-4fc7-b8e9-dffcf917be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-240275485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e274507-b918-4594-92e0-e877a450e62d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99694dcffecc4b939e2f55538d22ddea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:12Z,use_quota=True,user_id='76cb1067e1344f8ab8427ab456fe6c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dce806-2132-404a-b9c7-1d487cd3a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dce806-2132-404a-b9c7-1d487cd3a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05a358e-6780-4f8e-b198-5c16c50feea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05a358e-6780-4f8e-b198-5c16c50feea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e274507-b918-4594-92e0-e877a450e62d', 'volume_name': 'volume-3e274507-b918-4594-92e0-e877a450e62d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878b3b8a-45e9-4c9e-9ad7-4483c40ff1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878b3b8a-45e9-4c9e-9ad7-4483c40ff1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee861fdb-fc63-44d7-b654-23bf030d97f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:12 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Volume 3e274507-b918-4594-92e0-e877a450e62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e274507-b918-4594-92e0-e877a450e62d', 'volume_size': 1} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-240275485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e274507-b918-4594-92e0-e877a450e62d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99694dcffecc4b939e2f55538d22ddea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:12Z,use_quota=True,user_id='76cb1067e1344f8ab8427ab456fe6c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Creating volume 3e274507-b918-4594-92e0-e877a450e62d {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:12 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8" returned: 0 in 0.818s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d 1073741824 Sep 23 00:23:12 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8 Sep 23 00:23:12 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d5e9e56c-a276-4160-ab53-d2af2693b4e8" returned: 0 in 0.493s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-quobyte-d5e9e56c-a276-4160-ab53-d2af2693b4e8" released by "delete_volume" :: held 1.402s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:12 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d 1073741824" returned: 0 in 0.676s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Created reservations ['f7880039-ec62-4cbd-bd88-6a3b70b7f6b6', '62654309-3f83-4341-9edb-40d3e11aa180', 'fa3d89b9-b5b9-4999-b6f8-37dcc3cd3636', '669f5f0b-1a5f-4b9c-8920-e457a7d7c19d', 'e5aa937d-7386-485c-be5a-f4694df5e7c8'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d Sep 23 00:23:12 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:13 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:13 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:13 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:13 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee861fdb-fc63-44d7-b654-23bf030d97f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e274507-b918-4594-92e0-e877a450e62d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4fc3f8-ed26-4716-98d9-a2ff3d2039dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Deleted volume successfully. Sep 23 00:23:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Volume volume-3e274507-b918-4594-92e0-e877a450e62d (3e274507-b918-4594-92e0-e877a450e62d): created successfully Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4fc3f8-ed26-4716-98d9-a2ff3d2039dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Flow 'volume_create_manager' (970f0870-bb68-40a0-8646-cbabe0fbe31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-7ae16570-a9ea-462f-aba5-8bf173b3e7de req-ac7d95bf-c5b6-4518-8c5d-9bae515c439c tempest-VolumesGetTestJSON-1876594964 None] Created volume successfully. Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-728e35cd-09ab-4ed7-bde1-0ddcb4f9775f tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-d5e9e56c-a276-4160-ab53-d2af2693b4e8-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "cinder-7569a5cb-2a59-47c2-a82c-893d5cce76c8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-7569a5cb-2a59-47c2-a82c-893d5cce76c8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "cinder-quobyte-7569a5cb-2a59-47c2-a82c-893d5cce76c8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-quobyte-7569a5cb-2a59-47c2-a82c-893d5cce76c8" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[824a54f6-e3ca-4819-a717-17304674bb8d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 Sep 23 00:23:14 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:14 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8" returned: 0 in 0.891s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Acquiring lock "cinder-3e274507-b918-4594-92e0-e877a450e62d-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:14 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8 Sep 23 00:23:14 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Lock "cinder-3e274507-b918-4594-92e0-e877a450e62d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Acquiring lock "cinder-quobyte-3e274507-b918-4594-92e0-e877a450e62d" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Lock "cinder-quobyte-3e274507-b918-4594-92e0-e877a450e62d" acquired by "delete_volume" :: waited 0.043s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64029e-0d3b-4b3c-9e8e-c200a586944c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:15 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d Sep 23 00:23:15 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7569a5cb-2a59-47c2-a82c-893d5cce76c8" returned: 0 in 0.621s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-quobyte-7569a5cb-2a59-47c2-a82c-893d5cce76c8" released by "delete_volume" :: held 1.619s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Created reservations ['1fd9bc28-d45f-4f06-8395-055b44273ebb', '50cfd6ed-e650-4b1b-a027-d633f6da836e', '7313e20f-38c4-447d-81a0-83adb1998fed', 'fe0b60ff-82cd-434d-bd13-7b9fdc29b679', 'edfe9f64-c362-45c3-a98e-5e8362d8cc6b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:15 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d" returned: 0 in 0.645s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:15 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d Sep 23 00:23:15 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:16 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8786b610-4d66-47fc-8056-b5574970cc06 req-99dccabe-66d9-4d22-aad0-41d90f9c1846 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8786b610-4d66-47fc-8056-b5574970cc06 req-99dccabe-66d9-4d22-aad0-41d90f9c1846 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8786b610-4d66-47fc-8056-b5574970cc06 req-99dccabe-66d9-4d22-aad0-41d90f9c1846 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-8786b610-4d66-47fc-8056-b5574970cc06 req-99dccabe-66d9-4d22-aad0-41d90f9c1846 tempest-TestInstancesWithCinderVolumes-274778151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-64608054-6464-4eca-9dce-8bf3f62e967b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e3d346b-fd6a-4e1d-846c-50b114d84020', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:23:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-8786b610-4d66-47fc-8056-b5574970cc06 req-99dccabe-66d9-4d22-aad0-41d90f9c1846 tempest-TestInstancesWithCinderVolumes-274778151 None] attachment_update completed successfully. Sep 23 00:23:16 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.609s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:16 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3e274507-b918-4594-92e0-e877a450e62d" returned: 0 in 0.698s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Deleted volume successfully. Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Lock "cinder-quobyte-3e274507-b918-4594-92e0-e877a450e62d" released by "delete_volume" :: held 1.440s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40df0a92-50e2-4bf7-b19e-f3c1285a97d5 tempest-AttachVolumeTestJSON-1628138625 None] Lock "cinder-7569a5cb-2a59-47c2-a82c-893d5cce76c8-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.quota [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Created reservations ['c227c5ac-52cd-461f-9c75-979062b8788e', '4acc8bb3-57e9-4c26-a41e-a50c9d1bd219', '782ad066-5b1c-4068-8f60-849780a54faa', '08197647-c502-4a2b-85db-73598d64ebbc', '8772d240-5cbf-49f3-bc5c-a49a76943f76'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:16 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:17 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.494s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:17 devstack cinder-volume[87292]: DEBUG cinder.manager [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Deleted volume successfully. Sep 23 00:23:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-a1803c9f-c505-4e53-b591-578b367a8c74 req-74c1e906-2e5b-4203-9cf9-097256fd1d20 tempest-VolumesGetTestJSON-1876594964 None] Lock "cinder-3e274507-b918-4594-92e0-e877a450e62d-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-dcd305c7-3370-42e1-bb00-361faed31107 req-bcfc4438-3e55-4c25-b598-8d2b15b0357f tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-dcd305c7-3370-42e1-bb00-361faed31107 req-bcfc4438-3e55-4c25-b598-8d2b15b0357f tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-dcd305c7-3370-42e1-bb00-361faed31107 req-bcfc4438-3e55-4c25-b598-8d2b15b0357f tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-dcd305c7-3370-42e1-bb00-361faed31107 req-bcfc4438-3e55-4c25-b598-8d2b15b0357f tempest-TestInstancesWithCinderVolumes-274778151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-f5222632-fdbd-4294-86cd-b63af9f0acd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74159f48-e735-4b8d-9f57-a76ab75e6aa6', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:23:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-dcd305c7-3370-42e1-bb00-361faed31107 req-bcfc4438-3e55-4c25-b598-8d2b15b0357f tempest-TestInstancesWithCinderVolumes-274778151 None] attachment_update completed successfully. Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Flow 'volume_create_manager' (07056525-6958-493f-a1ec-2dffdf4a91e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3c0866-92f3-4d9f-a826-b6d7fbc62805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3c0866-92f3-4d9f-a826-b6d7fbc62805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-596634916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0bd658a10054149838ed8ece7a4d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:26Z,use_quota=True,user_id='2534bbd88e5d4a33906e043b518283ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e87f797-423d-43b4-9a0e-c5338379d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e87f797-423d-43b4-9a0e-c5338379d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c152867-98a8-4593-97d1-158f1b525936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c152867-98a8-4593-97d1-158f1b525936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8', 'volume_name': 'volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40562002-038f-47e1-9a48-217301138fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40562002-038f-47e1-9a48-217301138fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7393e0d1-d255-4b1e-aa5a-4880cdd423bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Volume 44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8', 'volume_size': 1} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-596634916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0bd658a10054149838ed8ece7a4d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:26Z,use_quota=True,user_id='2534bbd88e5d4a33906e043b518283ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Creating volume 44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:25 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:23:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:26 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 1073741824 Sep 23 00:23:26 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:26 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 1073741824" returned: 0 in 0.865s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:26 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 Sep 23 00:23:26 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:27 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8" returned: 0 in 0.431s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7393e0d1-d255-4b1e-aa5a-4880cdd423bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d290ebab-f7ac-4ec1-9710-5084ae01d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:27 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Volume volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 (44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8): created successfully Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d290ebab-f7ac-4ec1-9710-5084ae01d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Flow 'volume_create_manager' (07056525-6958-493f-a1ec-2dffdf4a91e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a172111b-1d6d-4c0b-904b-9fa0f76e6073 tempest-VolumesTestJSON-2112545529 None] Created volume successfully. Sep 23 00:23:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-71ce9dcb-13a7-4703-b250-4b42e32c8031 req-2ef7a83d-03ca-41f4-bb94-1c280f319474 tempest-TestInstancesWithCinderVolumes-274778151 None] Terminate volume connection completed successfully. Sep 23 00:23:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-71ce9dcb-13a7-4703-b250-4b42e32c8031 req-2ef7a83d-03ca-41f4-bb94-1c280f319474 tempest-TestInstancesWithCinderVolumes-274778151 None] Deleting attachment 3e3d346b-fd6a-4e1d-846c-50b114d84020. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "cinder-64608054-6464-4eca-9dce-8bf3f62e967b-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-64608054-6464-4eca-9dce-8bf3f62e967b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "cinder-quobyte-64608054-6464-4eca-9dce-8bf3f62e967b" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-quobyte-64608054-6464-4eca-9dce-8bf3f62e967b" acquired by "delete_volume" :: waited 0.060s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ee7f19-77ee-4b0f-b64c-e65c0d5b168f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:28 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Flow 'volume_create_manager' (21290fcf-1da4-417e-9383-a0c09edf06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba73a3a-9f19-423d-867c-3dba5b25dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba73a3a-9f19-423d-867c-3dba5b25dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-676836222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548878e2-b874-4f89-9b09-a1e3766ba8e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0bd658a10054149838ed8ece7a4d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:29Z,use_quota=True,user_id='2534bbd88e5d4a33906e043b518283ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b863e1d8-ab0a-45d9-be4b-152da00c4366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b863e1d8-ab0a-45d9-be4b-152da00c4366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1e552e-a624-43e6-96ae-a3fb7481a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1e552e-a624-43e6-96ae-a3fb7481a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548878e2-b874-4f89-9b09-a1e3766ba8e0', 'volume_name': 'volume-548878e2-b874-4f89-9b09-a1e3766ba8e0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a82978-c741-470d-aa93-1ace2a15d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a82978-c741-470d-aa93-1ace2a15d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6826412-0801-44bb-990a-a24f79613de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:29 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Volume 548878e2-b874-4f89-9b09-a1e3766ba8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548878e2-b874-4f89-9b09-a1e3766ba8e0', 'volume_size': 1} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-676836222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548878e2-b874-4f89-9b09-a1e3766ba8e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0bd658a10054149838ed8ece7a4d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:29Z,use_quota=True,user_id='2534bbd88e5d4a33906e043b518283ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Creating volume 548878e2-b874-4f89-9b09-a1e3766ba8e0 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:29 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:29 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b Sep 23 00:23:29 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:29 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 1073741824 Sep 23 00:23:29 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:29 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b" returned: 0 in 0.797s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:29 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b Sep 23 00:23:29 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:29 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 1073741824" returned: 0 in 0.714s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:29 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 Sep 23 00:23:29 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:30 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-64608054-6464-4eca-9dce-8bf3f62e967b" returned: 0 in 0.429s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-quobyte-64608054-6464-4eca-9dce-8bf3f62e967b" released by "delete_volume" :: held 1.326s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:30 devstack cinder-volume[87292]: WARNING cinder.quota [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-834304242-86138922 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-834304242-86138922, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:30 devstack cinder-volume[87292]: WARNING cinder.quota [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-834304242-86138922 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-834304242-86138922, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Created reservations ['f664a35a-058a-4049-bdfa-004d567eae37', 'b95ab1f2-f268-46a7-bea4-2078d9830617', 'f617d96d-265f-48a1-95ea-d4dd33284eed', '7396971f-5c32-4aa4-89ea-a740fa924e65', '405e1fa2-84ec-4f01-9465-fc8645ab2612'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:30 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0" returned: 0 in 0.570s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:30 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:30 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6826412-0801-44bb-990a-a24f79613de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548878e2-b874-4f89-9b09-a1e3766ba8e0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa0abd0-6557-4388-898c-cee9e1636137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:30 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Volume volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 (548878e2-b874-4f89-9b09-a1e3766ba8e0): created successfully Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa0abd0-6557-4388-898c-cee9e1636137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Flow 'volume_create_manager' (21290fcf-1da4-417e-9383-a0c09edf06b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f25bb599-03ac-4dad-80db-ec68720e6bf7 tempest-VolumesTestJSON-2112545529 None] Created volume successfully. Sep 23 00:23:30 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.430s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Deleted volume successfully. Sep 23 00:23:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8e2b3198-7b00-4f40-9098-6bbc662b22a0 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-64608054-6464-4eca-9dce-8bf3f62e967b-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-55eb4c9c-3247-4a79-98e4-40c4b8061264 tempest-BackendsCapabilitiesAdminTestsJSON-118457728 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87292) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4551f489-13f9-4952-be0b-86146fd67ad8 tempest-BackendsCapabilitiesAdminTestsJSON-118457728 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87292) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Flow 'volume_create_manager' (95406b81-77af-4bda-8665-1888e07464d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7d597d-b26c-4bc3-86d4-615a7f1d0657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7d597d-b26c-4bc3-86d4-615a7f1d0657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2145053571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db0f6ee-4ea4-4c6a-8985-6af9c236c534,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0bd658a10054149838ed8ece7a4d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:32Z,use_quota=True,user_id='2534bbd88e5d4a33906e043b518283ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58935653-0a7a-46e3-90a8-2c650ff96fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58935653-0a7a-46e3-90a8-2c650ff96fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a624d9-2b9d-43c9-a3a9-e6919b584eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a624d9-2b9d-43c9-a3a9-e6919b584eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db0f6ee-4ea4-4c6a-8985-6af9c236c534', 'volume_name': 'volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b838df59-1e72-463f-a62e-ad1a483912b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b838df59-1e72-463f-a62e-ad1a483912b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8230ff5a-acfd-4b65-a1c6-32fd402e3a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Volume 0db0f6ee-4ea4-4c6a-8985-6af9c236c534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534', 'volume_size': 1} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2145053571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db0f6ee-4ea4-4c6a-8985-6af9c236c534,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0bd658a10054149838ed8ece7a4d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:32Z,use_quota=True,user_id='2534bbd88e5d4a33906e043b518283ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Creating volume 0db0f6ee-4ea4-4c6a-8985-6af9c236c534 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:32 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:23:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:32 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 1073741824 Sep 23 00:23:32 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:33 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 1073741824" returned: 0 in 0.724s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:33 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 Sep 23 00:23:33 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:33 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8230ff5a-acfd-4b65-a1c6-32fd402e3a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c8186-6bf9-4c28-bdf9-d4c604e00bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:33 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Volume volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 (0db0f6ee-4ea4-4c6a-8985-6af9c236c534): created successfully Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c8186-6bf9-4c28-bdf9-d4c604e00bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Flow 'volume_create_manager' (95406b81-77af-4bda-8665-1888e07464d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-acb7b191-e76c-4a74-ad3a-4d1e64970d29 tempest-VolumesTestJSON-2112545529 None] Created volume successfully. Sep 23 00:23:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-46b2c137-df72-488b-a9ea-4537bd506f58 req-509a92b3-8649-4885-bc08-5c40812fcdcb tempest-TestInstancesWithCinderVolumes-274778151 None] Terminate volume connection completed successfully. Sep 23 00:23:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-46b2c137-df72-488b-a9ea-4537bd506f58 req-509a92b3-8649-4885-bc08-5c40812fcdcb tempest-TestInstancesWithCinderVolumes-274778151 None] Deleting attachment 74159f48-e735-4b8d-9f57-a76ab75e6aa6. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "cinder-f5222632-fdbd-4294-86cd-b63af9f0acd7-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-f5222632-fdbd-4294-86cd-b63af9f0acd7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "cinder-quobyte-f5222632-fdbd-4294-86cd-b63af9f0acd7" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-quobyte-f5222632-fdbd-4294-86cd-b63af9f0acd7" acquired by "delete_volume" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd1c59-2a27-4f83-beb9-8f62519075b7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:35 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 Sep 23 00:23:35 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7" returned: 0 in 0.969s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:36 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7 Sep 23 00:23:36 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "cinder-0db0f6ee-4ea4-4c6a-8985-6af9c236c534-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-0db0f6ee-4ea4-4c6a-8985-6af9c236c534-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "cinder-quobyte-0db0f6ee-4ea4-4c6a-8985-6af9c236c534" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-quobyte-0db0f6ee-4ea4-4c6a-8985-6af9c236c534" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d7b3c-4cde-44af-8c15-00a0edc9a45e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f5222632-fdbd-4294-86cd-b63af9f0acd7" returned: 0 in 0.534s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-quobyte-f5222632-fdbd-4294-86cd-b63af9f0acd7" released by "delete_volume" :: held 1.621s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:37 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 Sep 23 00:23:37 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack cinder-volume[87292]: WARNING cinder.quota [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731939495-1760850936 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731939495-1760850936, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:37 devstack cinder-volume[87292]: WARNING cinder.quota [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731939495-1760850936 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731939495-1760850936, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Created reservations ['5dc3ab99-9c33-40e8-851d-a0837a14bd49', '239a4afb-b4dc-4ade-970c-52c447f9d0b6', 'd1cbc54b-c1cf-44ad-9f16-12a84182ff64', 'b63ca964-dc2f-4a9e-8d66-268754382c96', 'bd690420-4d15-493a-8596-386dec804811'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:37 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534" returned: 0 in 0.603s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534 Sep 23 00:23:37 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.426s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Deleted volume successfully. Sep 23 00:23:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-017d4d8b-9b2c-453c-b983-ed66a4e0f4a5 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-f5222632-fdbd-4294-86cd-b63af9f0acd7-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:38 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0db0f6ee-4ea4-4c6a-8985-6af9c236c534" returned: 0 in 0.586s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-quobyte-0db0f6ee-4ea4-4c6a-8985-6af9c236c534" released by "delete_volume" :: held 1.280s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Created reservations ['929e8717-e7d2-40f6-b247-4dcefe2a5225', '40f7d997-5c50-4757-81c2-26ad756bfc23', '0ce84aac-6237-4a60-8a21-5e1ec5ef1c10', '08c14928-3429-4dee-9684-6c8339f09467', 'e344e42a-ef66-4234-8d48-e766ba487f0f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:38 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:38 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:38 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.398s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Deleted volume successfully. Sep 23 00:23:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a5dfb95-8a78-4ed7-9c54-7ea9e0b755c2 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-0db0f6ee-4ea4-4c6a-8985-6af9c236c534-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Acquiring lock "cinder-548878e2-b874-4f89-9b09-a1e3766ba8e0-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Lock "cinder-548878e2-b874-4f89-9b09-a1e3766ba8e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Acquiring lock "cinder-quobyte-548878e2-b874-4f89-9b09-a1e3766ba8e0" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Lock "cinder-quobyte-548878e2-b874-4f89-9b09-a1e3766ba8e0" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f3a16-2626-4e41-8bb8-966ef60f1462]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:39 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 Sep 23 00:23:39 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:39 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0" returned: 0 in 0.548s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:39 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0 Sep 23 00:23:39 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:40 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-548878e2-b874-4f89-9b09-a1e3766ba8e0" returned: 0 in 0.637s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Lock "cinder-quobyte-548878e2-b874-4f89-9b09-a1e3766ba8e0" released by "delete_volume" :: held 1.295s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Created reservations ['e081e300-3691-4641-a63f-b8d87773096b', '1989fc82-37cd-4704-9513-667b8040f2c4', '03cbcb21-a050-4200-9ca6-a3fad7442f4b', 'ca3be934-7885-42cb-8b72-6aa5849fd8c4', '46a0df36-8c58-4fe2-a4fa-79e52308f500'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:40 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:40 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:41 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.569s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Deleted volume successfully. Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-db2c078f-0125-459c-91e3-c2d842ba4ffa tempest-VolumesTestJSON-2112545529 None] Lock "cinder-548878e2-b874-4f89-9b09-a1e3766ba8e0-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "cinder-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "cinder-quobyte-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-quobyte-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa551c-7872-41a9-a033-30169397f67a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:42 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 Sep 23 00:23:42 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:42 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8" returned: 0 in 0.619s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:42 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8 Sep 23 00:23:42 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:43 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8" returned: 0 in 0.574s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-quobyte-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8" released by "delete_volume" :: held 1.291s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Created reservations ['0347cf68-b63d-4348-adfb-9052c287b9a7', '4cb7ca78-8072-4c5c-ade3-6b21f8b947ec', 'b2eadf1f-ab2b-42c3-b660-ebb3ac13650f', 'd72654fd-d419-4470-8bad-2836d173c7eb', 'a0772215-c2fb-41c6-b966-eefa8cb9b0a2'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-09b1fd63-02e5-43f3-9553-eaa601d693b3 req-efb6696c-acf3-48b9-b45f-c05824d0ae84 tempest-TestInstancesWithCinderVolumes-274778151 None] Terminate volume connection completed successfully. Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-09b1fd63-02e5-43f3-9553-eaa601d693b3 req-efb6696c-acf3-48b9-b45f-c05824d0ae84 tempest-TestInstancesWithCinderVolumes-274778151 None] Deleting attachment f0edca58-8037-450a-8f5a-f90b50599032. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:43 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:43 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:43 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Deleted volume successfully. Sep 23 00:23:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9f5b87a6-f3e9-4e4b-b520-290e088b7524 tempest-VolumesTestJSON-2112545529 None] Lock "cinder-44a2e7f4-a3d4-4381-81f3-6bc96fdf80f8-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "cinder-627c5d3e-e71f-41e3-87a6-d926e7c1cd18-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-627c5d3e-e71f-41e3-87a6-d926e7c1cd18-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "cinder-quobyte-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-quobyte-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:45 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3ba49-986b-4e07-adf6-633be18825d5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 Sep 23 00:23:45 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:46 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" returned: 0 in 0.620s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:46 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18 Sep 23 00:23:46 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:46 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" returned: 0 in 0.506s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-quobyte-627c5d3e-e71f-41e3-87a6-d926e7c1cd18" released by "delete_volume" :: held 1.208s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:47 devstack cinder-volume[87292]: WARNING cinder.quota [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745824040-1469123068 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745824040-1469123068, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:47 devstack cinder-volume[87292]: WARNING cinder.quota [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745824040-1469123068 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745824040-1469123068, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Created reservations ['7f162eb5-f2f5-4c23-aeb6-b00556f1217c', '86b279e6-c536-4381-83a2-bcfa84cd54d8', '9c533509-aebd-41e6-b01c-86d8fa31fa0c', '10e06701-1c9c-4390-9cc1-36f8b0e0ad8e', 'b1d73369-5e4f-47e3-afd6-a212820a5bba'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:47 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:47 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:47 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.403s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Deleted volume successfully. Sep 23 00:23:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a24e826b-3050-43d4-b6dd-63b27a77a2c4 tempest-TestInstancesWithCinderVolumes-274778151 None] Lock "cinder-627c5d3e-e71f-41e3-87a6-d926e7c1cd18-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Flow 'volume_create_manager' (0ca3035a-e913-48fa-855b-e0b917e86857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e8fcb0-e9d3-472b-8f33-15fdc49719c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e8fcb0-e9d3-472b-8f33-15fdc49719c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1335123619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bacda6471749aeaf88a81a4df73bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:48Z,use_quota=True,user_id='dd113fe7c5e44b56b1160f68ff1f54cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b1b9a0-4e09-400c-8cb6-36b7bdf0fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b1b9a0-4e09-400c-8cb6-36b7bdf0fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa66bd43-f667-41ee-97da-b4f4f8e4c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa66bd43-f667-41ee-97da-b4f4f8e4c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64', 'volume_name': 'volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ace7d6-ff45-4778-88aa-88582469ac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ace7d6-ff45-4778-88aa-88582469ac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fc28a7-bfe7-444b-b0c0-17eeae097b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Volume 6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64', 'volume_size': 1} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1335123619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bacda6471749aeaf88a81a4df73bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:48Z,use_quota=True,user_id='dd113fe7c5e44b56b1160f68ff1f54cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Creating volume 6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:48 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:23:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:48 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 1073741824 Sep 23 00:23:48 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:49 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 1073741824" returned: 0 in 0.741s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:49 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 Sep 23 00:23:49 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:49 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fc28a7-bfe7-444b-b0c0-17eeae097b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6a5186-ce33-4b19-b725-6db811870872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:49 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Volume volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 (6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64): created successfully Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6a5186-ce33-4b19-b725-6db811870872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Flow 'volume_create_manager' (0ca3035a-e913-48fa-855b-e0b917e86857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1e450a2e-faf2-4d1a-b752-725cf40a97ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Created volume successfully. Sep 23 00:23:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "cinder-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "cinder-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "cinder-quobyte-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "cinder-quobyte-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:50 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6f654-b172-4e80-9c4d-1846146697f7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:51 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 Sep 23 00:23:51 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:51 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64" returned: 0 in 0.572s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:51 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64 Sep 23 00:23:51 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:52 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64" returned: 0 in 0.663s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "cinder-quobyte-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64" released by "delete_volume" :: held 1.352s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Created reservations ['ba6ff07a-8ae1-4b38-b3e9-daed7726766a', '0606817d-0d87-4de8-a306-c60c241140c2', 'f087ae1b-2ffc-4e27-826e-23dcadb27ea2', 'b47c223e-48b8-46d0-b5b1-3055a322f0e1', '07a753c1-a2ad-4f0b-9b2d-6ae6fc2d53ce'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:52 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:52 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:53 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 1.079s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Deleted volume successfully. Sep 23 00:23:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-90653d7a-7af7-4b4b-ad1a-a52068521f9c tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "cinder-6cceed1f-fdec-4fd0-a8fb-1e3f6244fb64-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Flow 'volume_create_manager' (dfd2cfe1-f48d-436a-b888-7c98e7f2fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0b6528-bfa6-4f49-a5a4-f4cd4e9007aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:55 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:23:55 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0b6528-bfa6-4f49-a5a4-f4cd4e9007aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1098552249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fdec18-0bd1-4958-9c03-3ec4d250c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bacda6471749aeaf88a81a4df73bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:55Z,use_quota=True,user_id='dd113fe7c5e44b56b1160f68ff1f54cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877475ee-f79b-46a0-b53d-6c4a00c38c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877475ee-f79b-46a0-b53d-6c4a00c38c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aad645b-8e02-4b78-b510-a61c12cce3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aad645b-8e02-4b78-b510-a61c12cce3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fdec18-0bd1-4958-9c03-3ec4d250c6a5', 'volume_name': 'volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db58495-8f15-42ba-b908-acd3a27b6161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db58495-8f15-42ba-b908-acd3a27b6161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c5f068-50e5-4d0d-9839-e5c7b5c1895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:55 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Volume 34fdec18-0bd1-4958-9c03-3ec4d250c6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5', 'volume_size': 1} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1098552249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fdec18-0bd1-4958-9c03-3ec4d250c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bacda6471749aeaf88a81a4df73bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:55Z,use_quota=True,user_id='dd113fe7c5e44b56b1160f68ff1f54cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Creating volume 34fdec18-0bd1-4958-9c03-3ec4d250c6a5 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:55 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:55 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.684s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:55 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 1073741824 Sep 23 00:23:55 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:23:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:57 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 1073741824" returned: 0 in 1.476s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 Sep 23 00:23:57 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5" returned: 0 in 0.769s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c5f068-50e5-4d0d-9839-e5c7b5c1895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce80394-9197-48da-981d-b02b70b7a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:58 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Volume volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 (34fdec18-0bd1-4958-9c03-3ec4d250c6a5): created successfully Sep 23 00:23:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce80394-9197-48da-981d-b02b70b7a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Flow 'volume_create_manager' (dfd2cfe1-f48d-436a-b888-7c98e7f2fec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9be8b555-f14b-45c4-8ce6-7f3d295432ac tempest-VolumeQuotasAdminTestJSON-1740121892 None] Created volume successfully. Sep 23 00:24:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-498f45ba-d53f-4057-9596-7d9516a7c296 tempest-VolumeQuotasAdminTestJSON-470530007 None] Transfer volume completed successfully. Sep 23 00:24:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Acquiring lock "cinder-34fdec18-0bd1-4958-9c03-3ec4d250c6a5-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Lock "cinder-34fdec18-0bd1-4958-9c03-3ec4d250c6a5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Acquiring lock "cinder-quobyte-34fdec18-0bd1-4958-9c03-3ec4d250c6a5" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Lock "cinder-quobyte-34fdec18-0bd1-4958-9c03-3ec4d250c6a5" acquired by "delete_volume" :: waited 0.055s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:03 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcda99f-79ff-480d-b99f-5f8aeca4421c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:03 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 Sep 23 00:24:03 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:03 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5" returned: 0 in 0.728s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:03 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5 Sep 23 00:24:03 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:04 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-34fdec18-0bd1-4958-9c03-3ec4d250c6a5" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Lock "cinder-quobyte-34fdec18-0bd1-4958-9c03-3ec4d250c6a5" released by "delete_volume" :: held 1.352s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Created reservations ['e744fbfa-15d1-45a9-b4d5-011d1fc3e906', 'f73d089c-d2d3-447b-90ad-2937da156b3e', '6e4b9dd1-ea4d-49eb-a784-e037c9d50a6b', '2b1a5711-ad6c-48c9-8c17-d2f00aa739df', '0936316d-5f50-40d9-8a59-1218018a88cc'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:04 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:24:04 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:05 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.500s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:05 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Deleted volume successfully. Sep 23 00:24:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-185821eb-cf85-486c-87f2-be6e7b2a6f01 tempest-VolumeQuotasAdminTestJSON-992276139 None] Lock "cinder-34fdec18-0bd1-4958-9c03-3ec4d250c6a5-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:14 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=95,cinder:INSERT=31,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:15 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=134,cinder:SELECT=106,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:24 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Flow 'volume_create_manager' (1cedf806-06ee-4844-9050-6314f75094ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf6c493-0e27-4d98-80f9-c4b8e0fc661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf6c493-0e27-4d98-80f9-c4b8e0fc661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-661099046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e23124-892e-48a8-b5a4-075867241b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d5864624a747da9e2e11b9f063bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:25Z,use_quota=True,user_id='166cf09fd85644cba73e33282b8c624b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caf1ab5-ff56-4e84-9e2a-483d4b67efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caf1ab5-ff56-4e84-9e2a-483d4b67efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0bdc9f-acd8-4c13-925a-721645a7ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0bdc9f-acd8-4c13-925a-721645a7ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e23124-892e-48a8-b5a4-075867241b0d', 'volume_name': 'volume-11e23124-892e-48a8-b5a4-075867241b0d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cec06e-b248-48cf-a07e-f5f5555efa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cec06e-b248-48cf-a07e-f5f5555efa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff3c3d4-7b4b-40f3-9b6a-5682e57d4d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Volume 11e23124-892e-48a8-b5a4-075867241b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e23124-892e-48a8-b5a4-075867241b0d', 'volume_size': 1} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-661099046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e23124-892e-48a8-b5a4-075867241b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d5864624a747da9e2e11b9f063bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:25Z,use_quota=True,user_id='166cf09fd85644cba73e33282b8c624b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Creating volume 11e23124-892e-48a8-b5a4-075867241b0d {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:25 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:24:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d 1073741824 Sep 23 00:24:25 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d 1073741824" returned: 0 in 0.904s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:26 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d Sep 23 00:24:26 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d" returned: 0 in 0.546s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff3c3d4-7b4b-40f3-9b6a-5682e57d4d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e23124-892e-48a8-b5a4-075867241b0d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458fd6bc-fda7-49b7-a29b-e1e450e73eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Volume volume-11e23124-892e-48a8-b5a4-075867241b0d (11e23124-892e-48a8-b5a4-075867241b0d): created successfully Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458fd6bc-fda7-49b7-a29b-e1e450e73eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Flow 'volume_create_manager' (1cedf806-06ee-4844-9050-6314f75094ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:26 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0ab6f554-dbc0-493d-8127-d470fb5bfd36 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Created volume successfully. Sep 23 00:24:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-07509511-4d1a-4c61-849c-6714c98a9c47 req-fdf7b8d5-3342-488d-8484-1fc925ea0070 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-07509511-4d1a-4c61-849c-6714c98a9c47 req-fdf7b8d5-3342-488d-8484-1fc925ea0070 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-07509511-4d1a-4c61-849c-6714c98a9c47 req-fdf7b8d5-3342-488d-8484-1fc925ea0070 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-07509511-4d1a-4c61-849c-6714c98a9c47 req-fdf7b8d5-3342-488d-8484-1fc925ea0070 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-11e23124-892e-48a8-b5a4-075867241b0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3d36c71-b00e-4ea1-b035-971d5664572f', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:28 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-07509511-4d1a-4c61-849c-6714c98a9c47 req-fdf7b8d5-3342-488d-8484-1fc925ea0070 tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] attachment_update completed successfully. Sep 23 00:24:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-b8c53cd9-1136-4eea-a81a-ade19920afdd req-8e2a3d05-8629-4642-84de-c4f13c0db1eb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Terminate volume connection completed successfully. Sep 23 00:24:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-b8c53cd9-1136-4eea-a81a-ade19920afdd req-8e2a3d05-8629-4642-84de-c4f13c0db1eb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Deleting attachment e3d36c71-b00e-4ea1-b035-971d5664572f. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Acquiring lock "cinder-11e23124-892e-48a8-b5a4-075867241b0d-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "cinder-11e23124-892e-48a8-b5a4-075867241b0d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Acquiring lock "cinder-quobyte-11e23124-892e-48a8-b5a4-075867241b0d" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "cinder-quobyte-11e23124-892e-48a8-b5a4-075867241b0d" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:34 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc21e31-e2a7-422e-9af1-170a97884790]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d Sep 23 00:24:34 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:35 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d" returned: 0 in 0.699s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:35 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d Sep 23 00:24:35 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:35 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-11e23124-892e-48a8-b5a4-075867241b0d" returned: 0 in 0.468s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "cinder-quobyte-11e23124-892e-48a8-b5a4-075867241b0d" released by "delete_volume" :: held 1.237s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Created reservations ['94b399f2-e002-42cc-b1d2-f3e43d642ec3', 'f5474fb9-7a7c-4f6a-938f-30150f9a5b5e', 'c625e940-0050-4149-9580-d9910ab2b1d9', '227f03f3-cb3f-432d-a9bd-abccb0ca6661', 'b8441f08-499c-4ff6-80db-1e059c0fb148'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:35 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:24:35 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:36 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.384s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:36 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Deleted volume successfully. Sep 23 00:24:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a4da3ef-877b-43fa-8344-95c2a32669cb tempest-TestServerVolumeAttachScenarioOldVersion-712046078 None] Lock "cinder-11e23124-892e-48a8-b5a4-075867241b0d-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Flow 'volume_create_manager' (1cde4102-fb45-4162-8c1c-11dbb64da240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45309e4b-858c-468e-afb5-10983aaba5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45309e4b-858c-468e-afb5-10983aaba5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-665724981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bc140d-585b-480d-a58b-00f92672eaa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b24cbb5b9a46b5b4a444472f2c3fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:40Z,use_quota=True,user_id='30e66f50f248419ea7e5b399d97dd65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d13f4537-3819-49aa-9ae6-faa8da1853b7),volume_type_id=d13f4537-3819-49aa-9ae6-faa8da1853b7)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51536b49-67cb-45a6-acc4-8a030a7055b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51536b49-67cb-45a6-acc4-8a030a7055b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5112b4a7-ac3b-4aa7-af57-d043d5b77aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5112b4a7-ac3b-4aa7-af57-d043d5b77aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bc140d-585b-480d-a58b-00f92672eaa5', 'volume_name': 'volume-e2bc140d-585b-480d-a58b-00f92672eaa5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb48259-a2b0-47d2-b99f-9d8e7194a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb48259-a2b0-47d2-b99f-9d8e7194a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322da248-96b0-47d6-8468-d1cb226ee9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Volume e2bc140d-585b-480d-a58b-00f92672eaa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bc140d-585b-480d-a58b-00f92672eaa5', 'volume_size': 1} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-665724981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bc140d-585b-480d-a58b-00f92672eaa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b24cbb5b9a46b5b4a444472f2c3fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:40Z,use_quota=True,user_id='30e66f50f248419ea7e5b399d97dd65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d13f4537-3819-49aa-9ae6-faa8da1853b7),volume_type_id=d13f4537-3819-49aa-9ae6-faa8da1853b7)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Creating volume e2bc140d-585b-480d-a58b-00f92672eaa5 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:40 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:24:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 1073741824 Sep 23 00:24:40 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 1073741824" returned: 0 in 0.693s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 Sep 23 00:24:41 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5" returned: 0 in 0.374s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322da248-96b0-47d6-8468-d1cb226ee9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bc140d-585b-480d-a58b-00f92672eaa5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6670e9c2-d9fc-418e-9003-0ff81f637307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Volume volume-e2bc140d-585b-480d-a58b-00f92672eaa5 (e2bc140d-585b-480d-a58b-00f92672eaa5): created successfully Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6670e9c2-d9fc-418e-9003-0ff81f637307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Flow 'volume_create_manager' (1cde4102-fb45-4162-8c1c-11dbb64da240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f978061e-ec3a-4550-9705-849470de3cfb tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Created volume successfully. Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:43 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:24:43 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:43 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.479s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-36939e8f-70fe-468d-8a0c-ebaffb48573b tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Retype volume completed successfully. Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Acquiring lock "cinder-e2bc140d-585b-480d-a58b-00f92672eaa5-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "cinder-e2bc140d-585b-480d-a58b-00f92672eaa5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Acquiring lock "cinder-quobyte-e2bc140d-585b-480d-a58b-00f92672eaa5" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "cinder-quobyte-e2bc140d-585b-480d-a58b-00f92672eaa5" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa5f0d-0d9d-4474-bfbf-670eb4f911a3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:44 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 Sep 23 00:24:44 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:44 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:45 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5 Sep 23 00:24:45 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:45 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e2bc140d-585b-480d-a58b-00f92672eaa5" returned: 0 in 0.364s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "cinder-quobyte-e2bc140d-585b-480d-a58b-00f92672eaa5" released by "delete_volume" :: held 0.892s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:45 devstack cinder-volume[87292]: WARNING cinder.quota [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:45 devstack cinder-volume[87292]: WARNING cinder.quota [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Created reservations ['02e3d850-4fbd-4909-8263-8b57ad51ca1f', 'bfdc899b-7634-4423-9109-6b10382a24d2', 'e2491976-e242-451c-9337-c4ef03348baf', 'a752be8d-0148-40d7-a9e9-cd2230e3481e', '1b17ea2e-4f9c-4d17-8abe-f30a8a305be4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:45 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:24:45 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:46 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.552s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:46 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Deleted volume successfully. Sep 23 00:24:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b1308346-674a-4f53-a6c7-37acd6d101b7 tempest-VolumeRetypeWithoutMigrationTest-2108603137 None] Lock "cinder-e2bc140d-585b-480d-a58b-00f92672eaa5-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Flow 'volume_create_manager' (745a5aee-89b4-49a9-ad88-5c509b45c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931816cf-02a8-410a-9e86-c3e6bc7c7310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931816cf-02a8-410a-9e86-c3e6bc7c7310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1799683349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fb1c33-4a3a-41c0-bb75-3e32ef271f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4232bd8fc7dc43f1a25a70f0f614ae3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:48Z,use_quota=True,user_id='7d68bcc894674855bb4bfe0a688d476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e5a29b-f33c-4568-a47a-2f874555802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e5a29b-f33c-4568-a47a-2f874555802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43b2a42-ff3a-4ed6-bcd9-2c21c21f2d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43b2a42-ff3a-4ed6-bcd9-2c21c21f2d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fb1c33-4a3a-41c0-bb75-3e32ef271f1e', 'volume_name': 'volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9519074-8fcd-460b-b655-1f28d88e1596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9519074-8fcd-460b-b655-1f28d88e1596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aebbc27-d67d-4118-b240-e315acd75d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Volume 38fb1c33-4a3a-41c0-bb75-3e32ef271f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e', 'volume_size': 1} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1799683349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fb1c33-4a3a-41c0-bb75-3e32ef271f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4232bd8fc7dc43f1a25a70f0f614ae3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:48Z,use_quota=True,user_id='7d68bcc894674855bb4bfe0a688d476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Creating volume 38fb1c33-4a3a-41c0-bb75-3e32ef271f1e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:47 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:24:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e 1073741824 Sep 23 00:24:48 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Flow 'volume_create_manager' (fca04db0-0054-49cc-a116-4df7884d2f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871eb731-1c34-4888-9917-1ea752dc1818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871eb731-1c34-4888-9917-1ea752dc1818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1772445854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bc23ec-f1bd-4dd2-a789-281066955806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4232bd8fc7dc43f1a25a70f0f614ae3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:48Z,use_quota=True,user_id='7d68bcc894674855bb4bfe0a688d476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9e1480-fc30-4336-9a64-c12c50b5f0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9e1480-fc30-4336-9a64-c12c50b5f0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d977eb64-a8f5-401a-bcad-b18fe7b2325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d977eb64-a8f5-401a-bcad-b18fe7b2325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bc23ec-f1bd-4dd2-a789-281066955806', 'volume_name': 'volume-b4bc23ec-f1bd-4dd2-a789-281066955806', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09232055-2d3b-4e33-bad1-c13fef5db4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09232055-2d3b-4e33-bad1-c13fef5db4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b13fd17-c324-48ed-9758-eba33d1b8e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Volume b4bc23ec-f1bd-4dd2-a789-281066955806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bc23ec-f1bd-4dd2-a789-281066955806', 'volume_size': 1} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:48 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e 1073741824" returned: 0 in 0.858s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e Sep 23 00:24:48 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:49 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1772445854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bc23ec-f1bd-4dd2-a789-281066955806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4232bd8fc7dc43f1a25a70f0f614ae3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:48Z,use_quota=True,user_id='7d68bcc894674855bb4bfe0a688d476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Creating volume b4bc23ec-f1bd-4dd2-a789-281066955806 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:49 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aebbc27-d67d-4118-b240-e315acd75d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53422939-3a19-4129-9708-4aa5ac62b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:49 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 1073741824 Sep 23 00:24:49 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:49 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Volume volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e (38fb1c33-4a3a-41c0-bb75-3e32ef271f1e): created successfully Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53422939-3a19-4129-9708-4aa5ac62b062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Flow 'volume_create_manager' (745a5aee-89b4-49a9-ad88-5c509b45c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d3192583-344a-4f07-a0ea-72776d88b696 tempest-TestServerVolumeAttachmentScenario-197191718 None] Created volume successfully. Sep 23 00:24:50 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 1073741824" returned: 0 in 0.632s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:50 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 Sep 23 00:24:50 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806" returned: 0 in 0.354s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b13fd17-c324-48ed-9758-eba33d1b8e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bc23ec-f1bd-4dd2-a789-281066955806', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c86a0cf-da8e-4bc9-ae33-1ca0d31e620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:50 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Volume volume-b4bc23ec-f1bd-4dd2-a789-281066955806 (b4bc23ec-f1bd-4dd2-a789-281066955806): created successfully Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c86a0cf-da8e-4bc9-ae33-1ca0d31e620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Flow 'volume_create_manager' (fca04db0-0054-49cc-a116-4df7884d2f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3b7d8cd5-4892-4562-8146-d9ae946b5ae0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Created volume successfully. Sep 23 00:24:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:24:55 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.355s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:24:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=33,cinder:SELECT=37,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=33,cinder:UPDATE=40,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Flow 'volume_create_manager' (7b553df5-7256-4878-bf8e-919385c3f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107934da-1683-4631-8e08-d7c470a921bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107934da-1683-4631-8e08-d7c470a921bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-751033332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c216afcc-c5c7-4be1-93fd-d9659a007ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39de7840ef704807a492d9142cfb6bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:04Z,use_quota=True,user_id='bfef1f951b7e42f0a16c59b1ca1d428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41184d45-73b9-44fd-9c14-5afa157e91dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41184d45-73b9-44fd-9c14-5afa157e91dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bbc050-147c-45ec-adca-6483394b5f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bbc050-147c-45ec-adca-6483394b5f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c216afcc-c5c7-4be1-93fd-d9659a007ef5', 'volume_name': 'volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095a4fcf-62e5-42f1-abe3-1e46ee77e296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095a4fcf-62e5-42f1-abe3-1e46ee77e296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ce5eb2-44ed-4c74-b05c-a3a83a7d5b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Volume c216afcc-c5c7-4be1-93fd-d9659a007ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5', 'volume_size': 1} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-751033332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c216afcc-c5c7-4be1-93fd-d9659a007ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39de7840ef704807a492d9142cfb6bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:04Z,use_quota=True,user_id='bfef1f951b7e42f0a16c59b1ca1d428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Creating volume c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:04 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:04 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 1073741824 Sep 23 00:25:04 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:04 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 1073741824" returned: 0 in 0.640s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:04 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 Sep 23 00:25:04 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:05 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ce5eb2-44ed-4c74-b05c-a3a83a7d5b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae9119f-2fdd-4dc4-b14a-7a07123983d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Volume volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 (c216afcc-c5c7-4be1-93fd-d9659a007ef5): created successfully Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae9119f-2fdd-4dc4-b14a-7a07123983d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Flow 'volume_create_manager' (7b553df5-7256-4878-bf8e-919385c3f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2586a376-5f94-4292-8692-7bca7b54d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Created volume successfully. Sep 23 00:25:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Creating offline snapshot 12843af5-59d7-4b0f-a450-e4c7e6ef0459 of volume c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ab8577-00bc-4897-b25a-224cdd0dbe8a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:06 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 Sep 23 00:25:06 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:07 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5" returned: 0 in 0.729s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:07 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 1G Sep 23 00:25:07 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:08 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 1G" returned: 0 in 0.684s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:08 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 Sep 23 00:25:08 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:08 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459" returned: 0 in 0.505s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:08 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 is being set with open permissions: ugo+rw Sep 23 00:25:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:08 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 Sep 23 00:25:08 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459" returned: 0 in 0.388s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info Sep 23 00:25:09 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:09 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info is being set with open permissions: ugo+rw Sep 23 00:25:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info Sep 23 00:25:09 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.info" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3086d62e-d967-4cdb-ab7f-4641eab6766f tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Create snapshot completed successfully Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "cinder-12843af5-59d7-4b0f-a450-e4c7e6ef0459-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-12843af5-59d7-4b0f-a450-e4c7e6ef0459-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "cinder-quobyte-c216afcc-c5c7-4be1-93fd-d9659a007ef5" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-quobyte-c216afcc-c5c7-4be1-93fd-d9659a007ef5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "cinder-quobyte-12843af5-59d7-4b0f-a450-e4c7e6ef0459" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-quobyte-12843af5-59d7-4b0f-a450-e4c7e6ef0459" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Deleting offline snapshot 12843af5-59d7-4b0f-a450-e4c7e6ef0459 of volume c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] snapshot_file for this snap is: volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[079d3855-c032-4e26-96dd-3a39665f7209]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 Sep 23 00:25:12 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:12 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459" returned: 0 in 0.644s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef2b92-9713-4f78-84b3-e1e882a8e900]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 Sep 23 00:25:12 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 Sep 23 00:25:13 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459" returned: 0 in 0.513s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459 Sep 23 00:25:13 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5.12843af5-59d7-4b0f-a450-e4c7e6ef0459" returned: 0 in 0.389s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-quobyte-12843af5-59d7-4b0f-a450-e4c7e6ef0459" released by "_delete_snapshot" :: held 2.262s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-quobyte-c216afcc-c5c7-4be1-93fd-d9659a007ef5" released by "delete_snapshot" :: held 2.297s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:14 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Created reservations ['63d64fc8-646d-444b-9c8a-2184dd3bec3f', '37c64632-ce2c-42af-b2f5-2e060195dc00', '9f78117b-3784-47db-a0ba-930735cdb71c', '8e7749e7-c83b-458e-8969-424a5ddc7988', 'a254846c-dfea-49d6-bf59-a6ce26ff22e0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Delete snapshot completed successfully. Sep 23 00:25:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39d610c2-71b0-4da6-b7ff-24b31d90b275 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-12843af5-59d7-4b0f-a450-e4c7e6ef0459-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "cinder-c216afcc-c5c7-4be1-93fd-d9659a007ef5-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-c216afcc-c5c7-4be1-93fd-d9659a007ef5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "cinder-quobyte-c216afcc-c5c7-4be1-93fd-d9659a007ef5" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-quobyte-c216afcc-c5c7-4be1-93fd-d9659a007ef5" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e528a8c3-4e71-49ea-b3aa-90155e992f6e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 Sep 23 00:25:15 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5" returned: 0 in 0.712s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5 Sep 23 00:25:16 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c216afcc-c5c7-4be1-93fd-d9659a007ef5" returned: 0 in 0.559s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-quobyte-c216afcc-c5c7-4be1-93fd-d9659a007ef5" released by "delete_volume" :: held 1.398s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Created reservations ['9ac4b807-6aa1-47c7-8918-d1003d85371e', 'ee9d3939-f148-48a2-9450-1531f02a9ddf', 'a01c1732-bfc4-4fe2-9355-569c3e9a5f94', '6d57f9e2-7a0f-4e91-8af0-83848a41dbbc', 'edfde2c7-313d-4fad-8fcb-86fc1bf6a4b4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:17 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:17 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.897s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Deleted volume successfully. Sep 23 00:25:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42bcb628-59c7-4647-ade1-80ff7d5083d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1612263668 None] Lock "cinder-c216afcc-c5c7-4be1-93fd-d9659a007ef5-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:27 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=22,cinder:INSERT=6,cinder:SELECT=18,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:28 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (4e8fb036-733a-45d5-8992-7b1a37f18047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fd2cf5-68aa-455c-890e-1514c76a7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fd2cf5-68aa-455c-890e-1514c76a7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1304472816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b135a-e49a-475d-b70f-4f934f572cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:34Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393225a4-0e37-48d3-98f7-0777e6dcff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393225a4-0e37-48d3-98f7-0777e6dcff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610aaf4b-47d0-45b1-94ab-cf13d403653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610aaf4b-47d0-45b1-94ab-cf13d403653c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03b135a-e49a-475d-b70f-4f934f572cb1', 'volume_name': 'volume-f03b135a-e49a-475d-b70f-4f934f572cb1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6222c63a-b736-480f-8ae7-471d6d4c4b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6222c63a-b736-480f-8ae7-471d6d4c4b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb3838d-1cbf-458a-8f44-1252854377d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Volume f03b135a-e49a-475d-b70f-4f934f572cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03b135a-e49a-475d-b70f-4f934f572cb1', 'volume_size': 1} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1304472816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b135a-e49a-475d-b70f-4f934f572cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:34Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Creating volume f03b135a-e49a-475d-b70f-4f934f572cb1 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:34 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:34 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 1073741824 Sep 23 00:25:34 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Flow 'volume_create_manager' (e267d927-3d97-4111-957a-b91b0bf91e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036eda3c-5af5-4c68-ae2c-ff6509ccb862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036eda3c-5af5-4c68-ae2c-ff6509ccb862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-279827038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6fdec2-909c-4d89-a70a-c63c4a994588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6c89f3086e444b928f3cfa4330f10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:34Z,use_quota=True,user_id='c10aea12463044058a9946553a668185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb8e3260-371f-4da3-91df-fe04157b83c2),volume_type_id=fb8e3260-371f-4da3-91df-fe04157b83c2)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ff383e-8058-4c32-b060-de6c3c854d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ff383e-8058-4c32-b060-de6c3c854d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd5208c-1964-408a-ad3d-f0d36724cad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd5208c-1964-408a-ad3d-f0d36724cad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6fdec2-909c-4d89-a70a-c63c4a994588', 'volume_name': 'volume-2c6fdec2-909c-4d89-a70a-c63c4a994588', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b0b20-52ea-427c-89c5-c8aaa041f471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b0b20-52ea-427c-89c5-c8aaa041f471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359fc82f-0388-405d-8222-aee9c4853959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Volume 2c6fdec2-909c-4d89-a70a-c63c4a994588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6fdec2-909c-4d89-a70a-c63c4a994588', 'volume_size': 1} Sep 23 00:25:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:35 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 1073741824" returned: 0 in 0.789s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 Sep 23 00:25:35 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1" returned: 0 in 0.337s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-279827038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6fdec2-909c-4d89-a70a-c63c4a994588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6c89f3086e444b928f3cfa4330f10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:34Z,use_quota=True,user_id='c10aea12463044058a9946553a668185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb8e3260-371f-4da3-91df-fe04157b83c2),volume_type_id=fb8e3260-371f-4da3-91df-fe04157b83c2)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Creating volume 2c6fdec2-909c-4d89-a70a-c63c4a994588 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:35 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 1073741824 Sep 23 00:25:35 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb3838d-1cbf-458a-8f44-1252854377d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03b135a-e49a-475d-b70f-4f934f572cb1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b70920-0131-4a23-9870-acb091866748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:35 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Volume volume-f03b135a-e49a-475d-b70f-4f934f572cb1 (f03b135a-e49a-475d-b70f-4f934f572cb1): created successfully Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b70920-0131-4a23-9870-acb091866748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (4e8fb036-733a-45d5-8992-7b1a37f18047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-03f0d8d9-c881-4e08-ae5b-1ff3a9cb338b tempest-VolumesActionsTest-720829950 None] Created volume successfully. Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-17214311-55d2-480f-951d-2fbb14d95e9b tempest-VolumesActionsTest-720829950 None] Acquiring lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1" by "attach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-17214311-55d2-480f-951d-2fbb14d95e9b tempest-VolumesActionsTest-720829950 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1" acquired by "attach_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-17214311-55d2-480f-951d-2fbb14d95e9b tempest-VolumesActionsTest-720829950 None] Attaching volume f03b135a-e49a-475d-b70f-4f934f572cb1 to instance 1e83e87c-d131-4740-97d5-f30a6bd3a52d at mountpoint /dev/vdb on host None. Sep 23 00:25:36 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 1073741824" returned: 0 in 0.633s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-17214311-55d2-480f-951d-2fbb14d95e9b tempest-VolumesActionsTest-720829950 None] Attach volume completed successfully. Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-17214311-55d2-480f-951d-2fbb14d95e9b tempest-VolumesActionsTest-720829950 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1" released by "attach_volume" :: held 0.127s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 Sep 23 00:25:36 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588" returned: 0 in 0.338s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359fc82f-0388-405d-8222-aee9c4853959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6fdec2-909c-4d89-a70a-c63c4a994588', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61fbbeb-be56-484e-8984-31510f5c5fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:36 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Volume volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 (2c6fdec2-909c-4d89-a70a-c63c4a994588): created successfully Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61fbbeb-be56-484e-8984-31510f5c5fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Flow 'volume_create_manager' (e267d927-3d97-4111-957a-b91b0bf91e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-81f4c3ad-d59a-4c87-8192-70ed47c1360e tempest-VolumeTypesAccessTest-896189270 None] Created volume successfully. Sep 23 00:25:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61034951-9252-404c-a3f0-c354eb396ed9 tempest-VolumesActionsTest-133771176 None] Terminate volume connection completed successfully. Sep 23 00:25:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61034951-9252-404c-a3f0-c354eb396ed9 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-detach_volume" by "detach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61034951-9252-404c-a3f0-c354eb396ed9 tempest-VolumesActionsTest-133771176 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61034951-9252-404c-a3f0-c354eb396ed9 tempest-VolumesActionsTest-133771176 None] Detaching volume f03b135a-e49a-475d-b70f-4f934f572cb1 from instance 1e83e87c-d131-4740-97d5-f30a6bd3a52d. Sep 23 00:25:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61034951-9252-404c-a3f0-c354eb396ed9 tempest-VolumesActionsTest-133771176 None] Detach volume completed successfully. Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61034951-9252-404c-a3f0-c354eb396ed9 tempest-VolumesActionsTest-133771176 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Acquiring lock "cinder-2c6fdec2-909c-4d89-a70a-c63c4a994588-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-48910552-dea8-49b0-b92e-619b8c706cd3 tempest-VolumesActionsTest-720829950 None] Acquiring lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-detach_volume" by "detach_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Lock "cinder-2c6fdec2-909c-4d89-a70a-c63c4a994588-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-48910552-dea8-49b0-b92e-619b8c706cd3 tempest-VolumesActionsTest-720829950 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-48910552-dea8-49b0-b92e-619b8c706cd3 tempest-VolumesActionsTest-720829950 None] Volume detach called, but volume not attached. Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-48910552-dea8-49b0-b92e-619b8c706cd3 tempest-VolumesActionsTest-720829950 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Acquiring lock "cinder-quobyte-2c6fdec2-909c-4d89-a70a-c63c4a994588" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Lock "cinder-quobyte-2c6fdec2-909c-4d89-a70a-c63c4a994588" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa064332-4a9b-4311-b698-fe9000dd3e5b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 Sep 23 00:25:37 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Acquiring lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Acquiring lock "cinder-quobyte-f03b135a-e49a-475d-b70f-4f934f572cb1" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Lock "cinder-quobyte-f03b135a-e49a-475d-b70f-4f934f572cb1" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0158dcb8-09d7-4505-82f2-0c11604ed229]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 Sep 23 00:25:37 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588" returned: 0 in 0.493s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588 Sep 23 00:25:38 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1 Sep 23 00:25:38 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2c6fdec2-909c-4d89-a70a-c63c4a994588" returned: 0 in 0.289s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Lock "cinder-quobyte-2c6fdec2-909c-4d89-a70a-c63c4a994588" released by "delete_volume" :: held 0.847s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:38 devstack cinder-volume[87292]: WARNING cinder.quota [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1720028101 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1720028101, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:38 devstack cinder-volume[87292]: WARNING cinder.quota [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1720028101 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1720028101, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Created reservations ['e2c72af5-fe29-4c47-a6af-d190b0f7dc4f', '01d4a528-2447-423a-9fbd-8c750fd5c2d9', 'cbf15d0d-f449-47ab-9fb9-49759cf8d9a4', '64efbbf4-3a4b-4e56-a7dd-454c767e5cdc', 'd1ca14ce-8bf5-4aae-98e6-ccd875e9144e'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:38 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f03b135a-e49a-475d-b70f-4f934f572cb1" returned: 0 in 0.347s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Lock "cinder-quobyte-f03b135a-e49a-475d-b70f-4f934f572cb1" released by "delete_volume" :: held 0.826s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Created reservations ['f4212b06-0359-4cd9-af42-43003e53a58f', 'cd49356f-4317-4c21-94b0-62e9474ce582', '7c6692ab-68c1-4d69-8869-4cc8c70063f5', 'f40c668b-705d-4271-95dd-e03e5595d1fc', '680b2906-8cb0-408c-8d70-b0070c4d2efd'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:38 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.419s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Deleted volume successfully. Sep 23 00:25:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a23bf12e-99bc-4c48-b397-3d7ea5989998 tempest-VolumeTypesAccessTest-896189270 None] Lock "cinder-2c6fdec2-909c-4d89-a70a-c63c4a994588-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:39 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.520s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Deleted volume successfully. Sep 23 00:25:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-de8daebf-981f-4aa0-a91c-07f9eeb6a554 tempest-VolumesActionsTest-720829950 None] Lock "cinder-f03b135a-e49a-475d-b70f-4f934f572cb1-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (75ca1f63-64c2-4284-b21b-1526410464cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b097e509-e73e-4df7-8a3a-130f668ab0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b097e509-e73e-4df7-8a3a-130f668ab0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279504846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:43Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495e9666-cb77-4c09-b552-e9223b613b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495e9666-cb77-4c09-b552-e9223b613b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e311d5-4ab0-4c45-9d07-5e4fd803bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e311d5-4ab0-4c45-9d07-5e4fd803bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0', 'volume_name': 'volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cfd087-9b11-4600-ba33-a64fcbb43a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cfd087-9b11-4600-ba33-a64fcbb43a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979c9172-f4dd-4c14-abe6-2a70dd20b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Volume 8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0', 'volume_size': 1} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279504846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:43Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Creating volume 8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:43 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:43 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 1073741824 Sep 23 00:25:43 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 1073741824" returned: 0 in 0.811s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:44 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 Sep 23 00:25:44 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0" returned: 0 in 0.402s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979c9172-f4dd-4c14-abe6-2a70dd20b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37082986-511a-4929-9a6e-a7b686397662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Volume volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 (8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0): created successfully Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37082986-511a-4929-9a6e-a7b686397662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (75ca1f63-64c2-4284-b21b-1526410464cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3ba55b1f-65c1-4e47-a1ae-6e3dfdba3f52 tempest-VolumesActionsTest-720829950 None] Created volume successfully. Sep 23 00:25:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Lock "cinder-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-quobyte-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:45 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccb4be-0a90-4453-80f0-dd213674f206]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 Sep 23 00:25:45 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0" returned: 0 in 0.598s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0 Sep 23 00:25:46 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0" returned: 0 in 0.335s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0" released by "delete_volume" :: held 1.007s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Created reservations ['400b7c24-d9a8-4a6c-a3cc-5ef23a1a1a33', '1633901c-0c58-48e0-95ea-be269ab7efb3', 'f8761b6b-d59f-4ca9-a51a-4ed85213e804', '24faed49-4d82-4b8e-bc4b-44d28b3fb6e8', '3a63854d-41a1-40e2-ab20-7ccbc78d66ba'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:46 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.415s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Deleted volume successfully. Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5c1bddef-29af-4bfb-96de-ad17480d93c7 tempest-VolumesActionsTest-133771176 None] Lock "cinder-8c39aedf-3cc6-48ad-a4b5-18d5ab08e9f0-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-49399aa8-ee28-45fc-b821-02545372c972 req-17306a3d-6aab-4e81-a9f6-f57947a96675 tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-49399aa8-ee28-45fc-b821-02545372c972 req-17306a3d-6aab-4e81-a9f6-f57947a96675 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-49399aa8-ee28-45fc-b821-02545372c972 req-17306a3d-6aab-4e81-a9f6-f57947a96675 tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-49399aa8-ee28-45fc-b821-02545372c972 req-17306a3d-6aab-4e81-a9f6-f57947a96675 tempest-TestServerVolumeAttachmentScenario-197191718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c84f1bb-078a-4ede-91cf-af830dd14d91', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:25:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-49399aa8-ee28-45fc-b821-02545372c972 req-17306a3d-6aab-4e81-a9f6-f57947a96675 tempest-TestServerVolumeAttachmentScenario-197191718 None] attachment_update completed successfully. Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (249c1417-3446-49f4-a52a-e1026f097506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ca5749-c9d7-43ea-895e-177fb99beccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ca5749-c9d7-43ea-895e-177fb99beccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070059082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1860e9d5-3095-4e63-9fd5-3db42c4ac5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:49Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06216946-c8e4-48b2-8387-ebbbd5d84357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06216946-c8e4-48b2-8387-ebbbd5d84357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8917ef89-8073-427f-98b7-f1e5a85a6449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8917ef89-8073-427f-98b7-f1e5a85a6449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1860e9d5-3095-4e63-9fd5-3db42c4ac5e2', 'volume_name': 'volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ff73c-8f0c-436e-8c13-4db5e3e0f406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ff73c-8f0c-436e-8c13-4db5e3e0f406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14efc507-6a3a-4f47-886a-6ce243afeb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Volume 1860e9d5-3095-4e63-9fd5-3db42c4ac5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2', 'volume_size': 1} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070059082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1860e9d5-3095-4e63-9fd5-3db42c4ac5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:49Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Creating volume 1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:48 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 1073741824 Sep 23 00:25:48 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 1073741824" returned: 0 in 0.640s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 Sep 23 00:25:49 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14efc507-6a3a-4f47-886a-6ce243afeb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe57e21c-9277-4588-9c56-8ed901b2f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:50 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Volume volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 (1860e9d5-3095-4e63-9fd5-3db42c4ac5e2): created successfully Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe57e21c-9277-4588-9c56-8ed901b2f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (249c1417-3446-49f4-a52a-e1026f097506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a472a4c1-4d0e-4ef7-b947-aad2c59b6006 tempest-VolumesActionsTest-720829950 None] Created volume successfully. Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Lock "cinder-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-quobyte-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce1e6c-4b3e-4361-8c9d-f788db5f7336]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 Sep 23 00:25:51 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2" returned: 0 in 0.523s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2 Sep 23 00:25:51 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:52 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2" returned: 0 in 0.331s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2" released by "delete_volume" :: held 0.916s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Created reservations ['aed94237-e0dd-48fc-b24e-d87f7462f184', 'c9e7696d-d869-46c1-a25f-10ef98c547c3', 'ef91bcc9-d664-4f65-9b68-5727e3e6ad0a', '93cbd04b-1502-4904-8b25-f9884fd4e153', '8304a653-4cf3-409a-ae76-e4a811d6547a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:52 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:52 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:52 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Deleted volume successfully. Sep 23 00:25:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3b03241b-a704-4656-8faa-ffacdf2552b0 tempest-VolumesActionsTest-133771176 None] Lock "cinder-1860e9d5-3095-4e63-9fd5-3db42c4ac5e2-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-d9fcfddb-1e96-4d3e-82af-c39051ca6e24 req-fdcc7a9d-319f-4a7b-ba39-797baeebb91e tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-d9fcfddb-1e96-4d3e-82af-c39051ca6e24 req-fdcc7a9d-319f-4a7b-ba39-797baeebb91e tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-d9fcfddb-1e96-4d3e-82af-c39051ca6e24 req-fdcc7a9d-319f-4a7b-ba39-797baeebb91e tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-d9fcfddb-1e96-4d3e-82af-c39051ca6e24 req-fdcc7a9d-319f-4a7b-ba39-797baeebb91e tempest-TestServerVolumeAttachmentScenario-197191718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-b4bc23ec-f1bd-4dd2-a789-281066955806', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae490f25-0cb8-4317-93cb-28a687eee246', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:25:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-d9fcfddb-1e96-4d3e-82af-c39051ca6e24 req-fdcc7a9d-319f-4a7b-ba39-797baeebb91e tempest-TestServerVolumeAttachmentScenario-197191718 None] attachment_update completed successfully. Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (0d1a1956-9422-45fb-9f25-152c230e7673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5980ac9-1d60-4162-a100-07f77b81aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5980ac9-1d60-4162-a100-07f77b81aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-728027882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24341c6d-f563-4efd-9c3e-0c160427cb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:54Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e064acd-5bb6-4fd3-bb9f-abaff4997190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e064acd-5bb6-4fd3-bb9f-abaff4997190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a09a068-56fb-4879-8dc3-9aee4423861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a09a068-56fb-4879-8dc3-9aee4423861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24341c6d-f563-4efd-9c3e-0c160427cb56', 'volume_name': 'volume-24341c6d-f563-4efd-9c3e-0c160427cb56', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f35e5c-bfd3-4bec-adcb-56945e10f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f35e5c-bfd3-4bec-adcb-56945e10f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf0a582-81e7-4548-a24d-a4551ee6844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Volume 24341c6d-f563-4efd-9c3e-0c160427cb56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24341c6d-f563-4efd-9c3e-0c160427cb56', 'volume_size': 1} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-728027882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24341c6d-f563-4efd-9c3e-0c160427cb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:54Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Creating volume 24341c6d-f563-4efd-9c3e-0c160427cb56 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:54 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 1073741824 Sep 23 00:25:54 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:55 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:55 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 1073741824" returned: 0 in 0.637s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 Sep 23 00:25:55 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:55 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:55 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf0a582-81e7-4548-a24d-a4551ee6844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24341c6d-f563-4efd-9c3e-0c160427cb56', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fac2c56-042c-4eb4-84cc-fdb51d0d4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:55 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Volume volume-24341c6d-f563-4efd-9c3e-0c160427cb56 (24341c6d-f563-4efd-9c3e-0c160427cb56): created successfully Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fac2c56-042c-4eb4-84cc-fdb51d0d4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (0d1a1956-9422-45fb-9f25-152c230e7673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:55 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3d867ce6-6138-4496-8065-a2efe94d454a tempest-VolumesActionsTest-720829950 None] Created volume successfully. Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-24341c6d-f563-4efd-9c3e-0c160427cb56-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Lock "cinder-24341c6d-f563-4efd-9c3e-0c160427cb56-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-quobyte-24341c6d-f563-4efd-9c3e-0c160427cb56" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-24341c6d-f563-4efd-9c3e-0c160427cb56" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2d8950-63b7-471a-8a95-ddfec84243f1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-0cc35d51-5481-4889-b7c2-3d569152b6d7 req-f7b5b63a-fb28-4e69-8c67-e51bff9ce1c9 tempest-TestServerVolumeAttachmentScenario-197191718 None] Terminate volume connection completed successfully. Sep 23 00:25:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-0cc35d51-5481-4889-b7c2-3d569152b6d7 req-f7b5b63a-fb28-4e69-8c67-e51bff9ce1c9 tempest-TestServerVolumeAttachmentScenario-197191718 None] Deleting attachment ae490f25-0cb8-4317-93cb-28a687eee246. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:25:56 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 Sep 23 00:25:56 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:57 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56" returned: 0 in 0.609s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56 Sep 23 00:25:57 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:57 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-24341c6d-f563-4efd-9c3e-0c160427cb56" returned: 0 in 0.343s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-24341c6d-f563-4efd-9c3e-0c160427cb56" released by "delete_volume" :: held 1.034s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:57 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Created reservations ['8425e4d2-7458-4c9e-a416-77b27996b7cb', 'dedb4a2c-c958-4967-9a15-904f86b252c9', 'c192c22d-3a23-44bc-9b30-4e93bf991e0f', '76769dd5-460b-4781-950b-9c312f0f482e', '928d40f2-62e9-4e5a-aec9-615536f63436'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:25:58 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Deleted volume successfully. Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cff774ad-d043-4f7b-a196-62dc10063fff tempest-VolumesActionsTest-133771176 None] Lock "cinder-24341c6d-f563-4efd-9c3e-0c160427cb56-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-78cb355e-dc26-42a7-a8f8-a69b43b485f6 req-38745a96-7415-4d07-8b9c-365b8698c9a0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Terminate volume connection completed successfully. Sep 23 00:25:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-78cb355e-dc26-42a7-a8f8-a69b43b485f6 req-38745a96-7415-4d07-8b9c-365b8698c9a0 tempest-TestServerVolumeAttachmentScenario-197191718 None] Deleting attachment 0c84f1bb-078a-4ede-91cf-af830dd14d91. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (18b28a6e-2022-43db-9d97-21a48e6703ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab786958-838a-4b55-bc16-1e816f095081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab786958-838a-4b55-bc16-1e816f095081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1068401434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83892c72-8dda-456d-bf96-6806efba7972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:00Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f825bc-9aed-40bc-8fd9-181c8aeb1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f825bc-9aed-40bc-8fd9-181c8aeb1a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7572c26-ae06-4b31-a3d7-8e64e3280162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7572c26-ae06-4b31-a3d7-8e64e3280162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83892c72-8dda-456d-bf96-6806efba7972', 'volume_name': 'volume-83892c72-8dda-456d-bf96-6806efba7972', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5999e94-e59a-4751-819b-a2ff89d96ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5999e94-e59a-4751-819b-a2ff89d96ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8dac2a-7375-48b1-b7cc-4d161b7aac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:59 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Volume 83892c72-8dda-456d-bf96-6806efba7972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83892c72-8dda-456d-bf96-6806efba7972', 'volume_size': 1} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1068401434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83892c72-8dda-456d-bf96-6806efba7972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:00Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Creating volume 83892c72-8dda-456d-bf96-6806efba7972 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:59 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:25:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 1073741824 Sep 23 00:25:59 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:00 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 1073741824" returned: 0 in 0.841s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:00 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 Sep 23 00:26:00 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:01 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972" returned: 0 in 0.441s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8dac2a-7375-48b1-b7cc-4d161b7aac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83892c72-8dda-456d-bf96-6806efba7972', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03b278-e5e4-42f4-bdf9-92a9648c32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Volume volume-83892c72-8dda-456d-bf96-6806efba7972 (83892c72-8dda-456d-bf96-6806efba7972): created successfully Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03b278-e5e4-42f4-bdf9-92a9648c32c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (18b28a6e-2022-43db-9d97-21a48e6703ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cc035d3a-cc54-43e2-aeb5-b735780e191c tempest-VolumesActionsTest-720829950 None] Created volume successfully. Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Flow 'volume_create_manager' (7ff34ea6-2b9f-487a-8bd8-45a77dba0e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8094f4-151d-4fe1-9be9-41fc9ca26db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8094f4-151d-4fe1-9be9-41fc9ca26db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-861550152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54cbd13-bc21-44a7-a974-7ae9b7a80945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c4a59cae34aa0b0c17476d46b78f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:01Z,use_quota=True,user_id='42b18cfcbc3f403ebc3dd08204763785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e86865-988b-475f-b852-16eb2377a565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e86865-988b-475f-b852-16eb2377a565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877fffe5-cdc7-43f3-99e6-e863180e9174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877fffe5-cdc7-43f3-99e6-e863180e9174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54cbd13-bc21-44a7-a974-7ae9b7a80945', 'volume_name': 'volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d55430-2439-49b7-ba42-18184a11bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d55430-2439-49b7-ba42-18184a11bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a2bc4c-e082-4d72-952c-9a30d3c8ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Volume e54cbd13-bc21-44a7-a974-7ae9b7a80945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945', 'volume_size': 1} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-861550152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54cbd13-bc21-44a7-a974-7ae9b7a80945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c4a59cae34aa0b0c17476d46b78f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:01Z,use_quota=True,user_id='42b18cfcbc3f403ebc3dd08204763785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Creating volume e54cbd13-bc21-44a7-a974-7ae9b7a80945 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:01 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:26:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:01 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 1073741824 Sep 23 00:26:01 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-83892c72-8dda-456d-bf96-6806efba7972-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Lock "cinder-83892c72-8dda-456d-bf96-6806efba7972-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Acquiring lock "cinder-quobyte-83892c72-8dda-456d-bf96-6806efba7972" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-83892c72-8dda-456d-bf96-6806efba7972" acquired by "delete_volume" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d4d25-f3dc-435f-8a44-1d6dded29a6a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 Sep 23 00:26:02 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:02 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 1073741824" returned: 0 in 0.846s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 Sep 23 00:26:02 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:02 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972" returned: 0 in 0.522s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972 Sep 23 00:26:02 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:02 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945" returned: 0 in 0.385s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a2bc4c-e082-4d72-952c-9a30d3c8ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4a461e-7a0c-4946-81ca-564c1204affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Volume volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 (e54cbd13-bc21-44a7-a974-7ae9b7a80945): created successfully Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4a461e-7a0c-4946-81ca-564c1204affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Flow 'volume_create_manager' (7ff34ea6-2b9f-487a-8bd8-45a77dba0e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0ed8bfad-577b-4e51-a603-1e860b2adb8f tempest-AbsoluteLimitsTests-495802667 None] Created volume successfully. Sep 23 00:26:03 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-83892c72-8dda-456d-bf96-6806efba7972" returned: 0 in 0.381s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Lock "cinder-quobyte-83892c72-8dda-456d-bf96-6806efba7972" released by "delete_volume" :: held 0.990s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Created reservations ['52925993-df6f-4dc7-9aaa-1ab65409180a', '9c8c7d49-cf83-46ea-8ada-369e39d6794a', 'cc84475a-5c58-43c1-ad1d-e80bfe5493a3', '47df581a-0787-430b-acc2-a11720008e07', '4d3f099e-03d2-41c4-80ce-6b1d647f5443'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:03 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:03 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:03 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.345s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Deleted volume successfully. Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-78d7c618-236a-4653-b60f-22910c05d184 tempest-VolumesActionsTest-133771176 None] Lock "cinder-83892c72-8dda-456d-bf96-6806efba7972-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Acquiring lock "cinder-e54cbd13-bc21-44a7-a974-7ae9b7a80945-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Lock "cinder-e54cbd13-bc21-44a7-a974-7ae9b7a80945-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Acquiring lock "cinder-quobyte-e54cbd13-bc21-44a7-a974-7ae9b7a80945" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Lock "cinder-quobyte-e54cbd13-bc21-44a7-a974-7ae9b7a80945" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44936ec-c835-4a25-8358-8c37df8eea95]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:04 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 Sep 23 00:26:04 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "cinder-b4bc23ec-f1bd-4dd2-a789-281066955806-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-b4bc23ec-f1bd-4dd2-a789-281066955806-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "cinder-quobyte-b4bc23ec-f1bd-4dd2-a789-281066955806" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-quobyte-b4bc23ec-f1bd-4dd2-a789-281066955806" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db34c6-a760-4de7-8373-bfb6cdee7f5c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:04 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945" returned: 0 in 0.547s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:04 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945 Sep 23 00:26:04 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:04 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 Sep 23 00:26:04 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:04 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e54cbd13-bc21-44a7-a974-7ae9b7a80945" returned: 0 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Lock "cinder-quobyte-e54cbd13-bc21-44a7-a974-7ae9b7a80945" released by "delete_volume" :: held 1.003s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:05 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Created reservations ['59c69ef0-a3a2-4855-8909-f3402f7a4e90', 'd041cf6f-2412-41ac-af20-63089597f7b3', 'ba644dd9-578d-49ce-81df-1a2357713803', 'a277d937-0c40-4a66-b9e5-1061c2a0434a', 'edd499e2-e5e6-496d-9aac-c7d6550dd5c5'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806" returned: 0 in 0.534s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806 Sep 23 00:26:05 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (7fc3ace5-3aac-45aa-9859-779783f82d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85e0686-2ad4-4aa5-a99e-3a3deefcfd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85e0686-2ad4-4aa5-a99e-3a3deefcfd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1205658528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e1a323-6b70-4a9d-b777-56b06ab7ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:05Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39adeacc-448f-431b-bcac-e812144ad966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39adeacc-448f-431b-bcac-e812144ad966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28238e7-fa5c-4f3e-9557-b1d2ad931207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28238e7-fa5c-4f3e-9557-b1d2ad931207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e1a323-6b70-4a9d-b777-56b06ab7ab0e', 'volume_name': 'volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca04185-6119-4eac-afd1-7b23c0a9af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca04185-6119-4eac-afd1-7b23c0a9af44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5898563c-fefb-4651-aefe-de07ee1dde5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Volume a4e1a323-6b70-4a9d-b777-56b06ab7ab0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e', 'volume_size': 1} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1205658528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e1a323-6b70-4a9d-b777-56b06ab7ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03fd5536196a447a8b829462ca311dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:05Z,use_quota=True,user_id='5613a2eb41c749408848347779bc2abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Creating volume a4e1a323-6b70-4a9d-b777-56b06ab7ab0e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:05 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:05 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e 1073741824 Sep 23 00:26:05 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:05 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b4bc23ec-f1bd-4dd2-a789-281066955806" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-quobyte-b4bc23ec-f1bd-4dd2-a789-281066955806" released by "delete_volume" :: held 0.915s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Created reservations ['8dfd1965-26b8-4d19-94e8-5b06039a0cfd', '02eabe04-2814-4425-ba92-19eb16236f73', '15de3f9d-ba20-4329-9578-de52a45dd39e', '7dd7f12d-1afe-4b7d-a455-72c8213f9182', '85f53d2a-7f4c-4569-86e7-10c1ce0dce80'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:05 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Deleted volume successfully. Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b6da2de2-6bf2-49fb-9625-c061c202af36 tempest-AbsoluteLimitsTests-495802667 None] Lock "cinder-e54cbd13-bc21-44a7-a974-7ae9b7a80945-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:05 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:05 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e 1073741824" returned: 0 in 0.579s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e Sep 23 00:26:05 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.320s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Deleted volume successfully. Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-838a642b-38fe-4f53-b4c8-70e86193f8cc tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-b4bc23ec-f1bd-4dd2-a789-281066955806-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:06 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e" returned: 0 in 0.348s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5898563c-fefb-4651-aefe-de07ee1dde5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7736ec6-4864-4541-81aa-1c48720cca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Volume volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e (a4e1a323-6b70-4a9d-b777-56b06ab7ab0e): created successfully Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7736ec6-4864-4541-81aa-1c48720cca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Flow 'volume_create_manager' (7fc3ace5-3aac-45aa-9859-779783f82d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f519ebbd-e242-4296-be02-0964339586cb tempest-VolumesActionsTest-720829950 None] Created volume successfully. Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "cinder-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "cinder-quobyte-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-quobyte-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da75001-1e4a-4902-ba22-0e958ebfac56]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:06 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e Sep 23 00:26:06 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:07 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e" returned: 0 in 0.516s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:07 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e Sep 23 00:26:07 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:07 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e" returned: 0 in 0.346s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-quobyte-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e" released by "delete_volume" :: held 0.922s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:07 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Created reservations ['04c893c6-478c-40c2-93d7-65bc321e39b7', '92ab2b0b-9977-4954-8660-5c317291c04b', '42001c89-dbfd-4044-85e2-09ebcd63a484', 'fa0c791c-6ea2-45d8-9bbf-59c114acc537', '43832c4c-decd-4bd6-b957-4001f5789ee3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:08 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:08 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Acquiring lock "cinder-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Lock "cinder-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Acquiring lock "cinder-quobyte-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:08 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.383s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Deleted volume successfully. Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Lock "cinder-quobyte-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-726fa091-42b0-4e7d-a561-d2076873671a tempest-TestServerVolumeAttachmentScenario-197191718 None] Lock "cinder-38fb1c33-4a3a-41c0-bb75-3e32ef271f1e-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1abad6-a9a9-4e94-b60e-dcd8ace7f739]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:08 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e Sep 23 00:26:08 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:08 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e" returned: 0 in 0.497s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:09 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e Sep 23 00:26:09 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:09 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e" returned: 0 in 0.363s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Lock "cinder-quobyte-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e" released by "delete_volume" :: held 0.936s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Created reservations ['0ab78739-7f1d-4c7e-9dec-f2aab359b649', '64ecc313-298c-4878-9fcb-7a7c2698ade6', 'f2d08dd6-4e3d-49e7-bd47-9da0fa9cd430', 'f7b08b5d-760e-4df7-a37b-fc2700518920', 'c7f9078f-29e6-4edc-9510-85aa5e002acc'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:09 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:09 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:09 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Deleted volume successfully. Sep 23 00:26:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1811c307-6b68-4373-b197-c1e1242a4732 tempest-VolumesActionsTest-720829950 None] Lock "cinder-a4e1a323-6b70-4a9d-b777-56b06ab7ab0e-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Flow 'volume_create_manager' (04b9e990-9897-4dcf-85be-065c6e7dcee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea08389-3a4f-4bbf-916d-6e0fd32ae759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea08389-3a4f-4bbf-916d-6e0fd32ae759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-894682319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9dd731-c861-4661-b29c-d39bae2626bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e1bd6b862a4170861bfaa18b36e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:13Z,use_quota=True,user_id='e7bc315cd02b4b049abc696cc499327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465d33be-4d48-473e-ae23-cd486fc25e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465d33be-4d48-473e-ae23-cd486fc25e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cbb15d-f226-4e41-9f33-4756732ca865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cbb15d-f226-4e41-9f33-4756732ca865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9dd731-c861-4661-b29c-d39bae2626bd', 'volume_name': 'volume-eb9dd731-c861-4661-b29c-d39bae2626bd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46783eb-d1ea-4f70-b1ff-47ba1c43c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46783eb-d1ea-4f70-b1ff-47ba1c43c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f329aaa9-8f7c-47cb-95a8-541e0831bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Volume eb9dd731-c861-4661-b29c-d39bae2626bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9dd731-c861-4661-b29c-d39bae2626bd', 'volume_size': 1} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-894682319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9dd731-c861-4661-b29c-d39bae2626bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e1bd6b862a4170861bfaa18b36e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:13Z,use_quota=True,user_id='e7bc315cd02b4b049abc696cc499327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Creating volume eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:13 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:26:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd 1073741824 Sep 23 00:26:13 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd 1073741824" returned: 0 in 0.686s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd Sep 23 00:26:14 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd" returned: 0 in 0.429s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f329aaa9-8f7c-47cb-95a8-541e0831bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9dd731-c861-4661-b29c-d39bae2626bd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b79b34b-5cf4-4230-a815-e05d9f76cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:14 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Volume volume-eb9dd731-c861-4661-b29c-d39bae2626bd (eb9dd731-c861-4661-b29c-d39bae2626bd): created successfully Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b79b34b-5cf4-4230-a815-e05d9f76cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Flow 'volume_create_manager' (04b9e990-9897-4dcf-85be-065c6e7dcee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3cd0bdcd-aba8-4d7e-8f77-52c9e33d0d76 tempest-VolumesDeleteCascade-1029092147 None] Created volume successfully. Sep 23 00:26:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Creating offline snapshot a52c1ee9-64d3-4f90-af0c-e1870ef78f0c of volume eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f7bb8e-b16b-4c38-94cb-040df420027f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd Sep 23 00:26:16 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd" returned: 0 in 0.521s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c 1G Sep 23 00:26:16 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c 1G" returned: 0 in 0.611s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9dd731-c861-4661-b29c-d39bae2626bd -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9dd731-c861-4661-b29c-d39bae2626bd -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:17 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:17 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9dd731-c861-4661-b29c-d39bae2626bd -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c is being set with open permissions: ugo+rw Sep 23 00:26:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:17 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:17 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.369s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info Sep 23 00:26:17 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info" returned: 0 in 0.328s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info is being set with open permissions: ugo+rw Sep 23 00:26:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info Sep 23 00:26:18 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.info" returned: 0 in 0.326s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e6e6d407-e562-4148-b9a7-be4cad935e78 tempest-VolumesDeleteCascade-1029092147 None] Create snapshot completed successfully Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Creating offline snapshot 97b3b947-292f-4a90-a37d-b744c4160eac of volume eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba6dc31-20b8-4f93-88f8-a7f23c42d6c3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:19 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:19 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.512s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9dd731-c861-4661-b29c-d39bae2626bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac 1G Sep 23 00:26:19 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:20 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac 1G" returned: 0 in 0.674s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:20 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac Sep 23 00:26:20 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac" returned: 0 in 0.457s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:21 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac is being set with open permissions: ugo+rw Sep 23 00:26:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac Sep 23 00:26:21 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac" returned: 0 in 0.340s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:21 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d2a45abe-2d0e-48fe-96a9-7a5d82afe2e2 tempest-VolumesDeleteCascade-1029092147 None] Create snapshot completed successfully Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-eb9dd731-c861-4661-b29c-d39bae2626bd-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-eb9dd731-c861-4661-b29c-d39bae2626bd-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Performing cascade delete. {{(pid=87292) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-97b3b947-292f-4a90-a37d-b744c4160eac-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-97b3b947-292f-4a90-a37d-b744c4160eac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-97b3b947-292f-4a90-a37d-b744c4160eac" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-97b3b947-292f-4a90-a37d-b744c4160eac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Deleting offline snapshot 97b3b947-292f-4a90-a37d-b744c4160eac of volume eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] snapshot_file for this snap is: volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[099cbece-536a-48e0-bbb5-4fd14a9ba620]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac Sep 23 00:26:23 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:23 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac" returned: 0 in 0.592s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9dd731-c861-4661-b29c-d39bae2626bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:23 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[271f108f-ad80-49b1-a68a-0f5eab517d1e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:23 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.675s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9dd731-c861-4661-b29c-d39bae2626bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:24 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac Sep 23 00:26:24 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac" returned: 0 in 0.607s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:24 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac Sep 23 00:26:24 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:25 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.97b3b947-292f-4a90-a37d-b744c4160eac" returned: 0 in 0.357s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-97b3b947-292f-4a90-a37d-b744c4160eac" released by "_delete_snapshot" :: held 2.390s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" released by "delete_snapshot" :: held 2.420s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Created reservations ['d369fa55-ee7e-4067-8366-057ad0918e5c', 'f646e571-4058-4c7b-b302-6855f13f3347', '003a8b26-c7fa-4a08-ac7e-4e24def7cfdc', 'ae4c0541-6ae6-445a-9df9-d22b99ec7cec', '3f46a31f-9284-42d6-a50e-ef76af559e1d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Delete snapshot completed successfully. Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-97b3b947-292f-4a90-a37d-b744c4160eac-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-a52c1ee9-64d3-4f90-af0c-e1870ef78f0c-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-a52c1ee9-64d3-4f90-af0c-e1870ef78f0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Deleting offline snapshot a52c1ee9-64d3-4f90-af0c-e1870ef78f0c of volume eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] snapshot_file for this snap is: volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b46862-f35b-41fb-ac1e-efaca6df2bf0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:25 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:25 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:26 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.509s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:26 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9dd731-c861-4661-b29c-d39bae2626bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:26 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d471ec59-3947-44bc-a057-2fbb0ddeeec1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:26 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd Sep 23 00:26:26 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:26 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd" returned: 0 in 0.564s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:26 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:26 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:27 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.551s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:27 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c Sep 23 00:26:27 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:27 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd.a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" returned: 0 in 0.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-a52c1ee9-64d3-4f90-af0c-e1870ef78f0c" released by "_delete_snapshot" :: held 2.093s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" released by "delete_snapshot" :: held 2.118s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=112,cinder:UPDATE=128,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Created reservations ['388313ba-d633-46f0-a7e4-217f8ac818c7', '60e8baf7-cabe-4b2d-82bb-9d00323cd491', 'ae97fb8f-8690-438e-8b9d-cee0c80d59ce', '0a48fc4e-f731-47fb-956a-d7b590e97340', '7de97d39-4343-4867-8b63-10456e37afaf'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Delete snapshot completed successfully. Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-a52c1ee9-64d3-4f90-af0c-e1870ef78f0c-delete_snapshot" released by "delete_snapshot" :: held 2.413s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Snapshots deleted, issuing volume delete {{(pid=87292) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdd8b5b-3999-482c-aa3d-077f7aa335fb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:28 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd Sep 23 00:26:28 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:28 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd" returned: 0 in 0.609s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:28 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd Sep 23 00:26:28 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:28 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eb9dd731-c861-4661-b29c-d39bae2626bd" returned: 0 in 0.395s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-eb9dd731-c861-4661-b29c-d39bae2626bd" released by "delete_volume" :: held 1.111s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=144,cinder:SELECT=124,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Created reservations ['3b4fd064-2d4f-4849-bc4d-07bfccba68ec', 'c6cd9a1d-db04-43c5-b4f5-9bd7e5a33a39', 'b314faa3-aad6-4e3c-a921-eaf4edf4a243', '23d4492a-4a0c-4590-8426-19e529961deb', 'f1ed0647-b828-4b19-9d60-4a635c1c9c4e'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:29 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:29 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:29 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:29 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Deleted volume successfully. Sep 23 00:26:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-16a6acb8-e120-42e4-b997-4f23761724d6 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-eb9dd731-c861-4661-b29c-d39bae2626bd-delete_volume" released by "delete_volume" :: held 7.125s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Flow 'volume_create_manager' (1336ed11-9570-430c-a1fd-2dfc7558663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7463298e-835b-475e-baa1-1d00d3d0acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7463298e-835b-475e-baa1-1d00d3d0acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1853180622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdc7459-71a7-41cf-8738-877cdeb5a734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e1bd6b862a4170861bfaa18b36e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:30Z,use_quota=True,user_id='e7bc315cd02b4b049abc696cc499327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edec4ad0-4f3f-40aa-8bda-a8d3f7938a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edec4ad0-4f3f-40aa-8bda-a8d3f7938a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe67b87-ba83-46ba-a4e3-5370d8939ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe67b87-ba83-46ba-a4e3-5370d8939ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fdc7459-71a7-41cf-8738-877cdeb5a734', 'volume_name': 'volume-3fdc7459-71a7-41cf-8738-877cdeb5a734', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28be700-b1ce-4fc6-bcff-9a7c5a611959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28be700-b1ce-4fc6-bcff-9a7c5a611959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57366910-ea53-41d2-b1c2-51c17761175a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Volume 3fdc7459-71a7-41cf-8738-877cdeb5a734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fdc7459-71a7-41cf-8738-877cdeb5a734', 'volume_size': 1} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1853180622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdc7459-71a7-41cf-8738-877cdeb5a734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e1bd6b862a4170861bfaa18b36e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:30Z,use_quota=True,user_id='e7bc315cd02b4b049abc696cc499327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Creating volume 3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:30 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:26:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:30 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 1073741824 Sep 23 00:26:30 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 1073741824" returned: 0 in 0.617s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:31 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 Sep 23 00:26:31 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734" returned: 0 in 0.307s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57366910-ea53-41d2-b1c2-51c17761175a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fdc7459-71a7-41cf-8738-877cdeb5a734', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a349d1-c068-47f9-8a70-ee25f1f6a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Volume volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 (3fdc7459-71a7-41cf-8738-877cdeb5a734): created successfully Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a349d1-c068-47f9-8a70-ee25f1f6a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Flow 'volume_create_manager' (1336ed11-9570-430c-a1fd-2dfc7558663e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-66c23377-fe71-48de-9b51-f23cd8f154dc tempest-VolumesDeleteCascade-1029092147 None] Created volume successfully. Sep 23 00:26:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Creating offline snapshot 1c1dbfc6-7e00-4169-beaf-9626cfcf046e of volume 3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e8865-888a-48b2-a78f-8b529e51c045]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 Sep 23 00:26:33 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734" returned: 0 in 0.497s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e 1G Sep 23 00:26:33 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e 1G" returned: 0 in 0.840s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e Sep 23 00:26:34 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e" returned: 0 in 0.427s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e is being set with open permissions: ugo+rw Sep 23 00:26:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e Sep 23 00:26:34 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:35 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e" returned: 0 in 0.355s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:35 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info Sep 23 00:26:35 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:35 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info" returned: 0 in 0.393s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info is being set with open permissions: ugo+rw Sep 23 00:26:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:35 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info Sep 23 00:26:35 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:35 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.info" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-36e08b95-fae5-4939-9e03-db9395297945 tempest-VolumesDeleteCascade-1029092147 None] Create snapshot completed successfully Sep 23 00:26:36 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Flow 'volume_create_manager' (c6939303-8c31-45f2-adce-20584d727279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75316614-0f11-42b4-99a1-e21361675b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75316614-0f11-42b4-99a1-e21361675b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1100282255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a2853a-215d-4d9b-8ecc-93b26ae34a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e1bd6b862a4170861bfaa18b36e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c1dbfc6-7e00-4169-beaf-9626cfcf046e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:37Z,use_quota=True,user_id='e7bc315cd02b4b049abc696cc499327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68af33e7-6bdc-4606-a6fd-28afa511c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68af33e7-6bdc-4606-a6fd-28afa511c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a106dd9d-e929-4c4c-a02e-15161ddd21fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a106dd9d-e929-4c4c-a02e-15161ddd21fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90a2853a-215d-4d9b-8ecc-93b26ae34a8f', 'volume_name': 'volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f', 'volume_size': 1, 'snapshot_id': '1c1dbfc6-7e00-4169-beaf-9626cfcf046e'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b6fb64-7d41-4319-88e4-cbfaad4884a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b6fb64-7d41-4319-88e4-cbfaad4884a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544bb4c3-b590-493e-a20b-a030d9ea863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Volume 90a2853a-215d-4d9b-8ecc-93b26ae34a8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f', 'volume_size': 1, 'snapshot_id': '1c1dbfc6-7e00-4169-beaf-9626cfcf046e'} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-1c1dbfc6-7e00-4169-beaf-9626cfcf046e-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-1c1dbfc6-7e00-4169-beaf-9626cfcf046e-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Creating volume 90a2853a-215d-4d9b-8ecc-93b26ae34a8f from snapshot 1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] snapshot: 1c1dbfc6-7e00-4169-beaf-9626cfcf046e, volume: 90a2853a-215d-4d9b-8ecc-93b26ae34a8f, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fceaf53-7483-4b85-bc71-2bc76e3f635c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e Sep 23 00:26:37 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e" returned: 0 in 0.593s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fdc7459-71a7-41cf-8738-877cdeb5a734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb2dcb4-7728-42bd-8568-35d665128485]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 Sep 23 00:26:38 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734" returned: 0 in 0.511s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:38 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f Sep 23 00:26:38 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Flow 'volume_create_manager' (9fedf19c-90eb-4d81-aaaf-5b705428103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ba4085-e041-4e9e-825a-698b93131bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ba4085-e041-4e9e-825a-698b93131bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-367947719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07daaa8-80e3-44bd-803c-bdcc51fd313b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2149292c6f41838c0798be22d1464c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:42Z,use_quota=True,user_id='2cf014247f394b4a89919a719b2440ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b690054-b8f9-435d-9deb-3bc43a9a8ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b690054-b8f9-435d-9deb-3bc43a9a8ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bfdb16-bd97-448e-9305-cc889e2f0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bfdb16-bd97-448e-9305-cc889e2f0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07daaa8-80e3-44bd-803c-bdcc51fd313b', 'volume_name': 'volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc44c2-d3fb-4b69-9ce9-32d2de23aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc44c2-d3fb-4b69-9ce9-32d2de23aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f4e8e1-e194-4858-8b32-a0bf5a808e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Volume e07daaa8-80e3-44bd-803c-bdcc51fd313b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b', 'volume_size': 1} Sep 23 00:26:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:47 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" returned: 0 in 8.910s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:47 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Converted 1024.00 MB image at 114.91 MB/s Sep 23 00:26:47 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f is being set with open permissions: ugo+rw Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:47 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f Sep 23 00:26:47 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:47 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" returned: 0 in 0.289s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" released by "_copy_volume_from_snapshot" :: held 10.431s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-1c1dbfc6-7e00-4169-beaf-9626cfcf046e-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" released by "_create_volume_from_snapshot" :: held 10.520s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.551s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.082s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-367947719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07daaa8-80e3-44bd-803c-bdcc51fd313b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2149292c6f41838c0798be22d1464c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:42Z,use_quota=True,user_id='2cf014247f394b4a89919a719b2440ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Creating volume e07daaa8-80e3-44bd-803c-bdcc51fd313b {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:47 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:47 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b 1073741824 Sep 23 00:26:47 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544bb4c3-b590-493e-a20b-a030d9ea863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f', 'volume_size': 1, 'snapshot_id': '1c1dbfc6-7e00-4169-beaf-9626cfcf046e'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e60a54-5493-4b6a-b194-9bc43238f0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:47 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Volume volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f (90a2853a-215d-4d9b-8ecc-93b26ae34a8f): created successfully Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e60a54-5493-4b6a-b194-9bc43238f0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Flow 'volume_create_manager' (c6939303-8c31-45f2-adce-20584d727279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bb2d3885-81c7-434f-a08b-413af58a51f8 tempest-VolumesDeleteCascade-1029092147 None] Created volume successfully. Sep 23 00:26:48 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b 1073741824" returned: 0 in 0.577s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:48 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b Sep 23 00:26:48 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-3fdc7459-71a7-41cf-8738-877cdeb5a734-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-3fdc7459-71a7-41cf-8738-877cdeb5a734-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Performing cascade delete. {{(pid=87292) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-1c1dbfc6-7e00-4169-beaf-9626cfcf046e-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:48 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-1c1dbfc6-7e00-4169-beaf-9626cfcf046e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b" returned: 0 in 0.343s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-3fdc7459-71a7-41cf-8738-877cdeb5a734" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f4e8e1-e194-4858-8b32-a0bf5a808e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144f98bf-e0fe-4e1b-86a5-17c96bbbc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-3fdc7459-71a7-41cf-8738-877cdeb5a734" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-1c1dbfc6-7e00-4169-beaf-9626cfcf046e" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Volume volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b (e07daaa8-80e3-44bd-803c-bdcc51fd313b): created successfully Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144f98bf-e0fe-4e1b-86a5-17c96bbbc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Flow 'volume_create_manager' (9fedf19c-90eb-4d81-aaaf-5b705428103a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-1c1dbfc6-7e00-4169-beaf-9626cfcf046e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Deleting offline snapshot 1c1dbfc6-7e00-4169-beaf-9626cfcf046e of volume 3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] snapshot_file for this snap is: volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3415c59b-3bf4-4fd6-baf8-fa60ca97b57a tempest-VolumesTransfersV355Test-295391129 None] Created volume successfully. Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd82189c-8b75-45b6-8ed9-5a0fadc6d6f1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:49 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e Sep 23 00:26:49 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:49 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e" returned: 0 in 0.471s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fdc7459-71a7-41cf-8738-877cdeb5a734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[78287efb-7ce2-45e3-bb7f-ba9c1c49a382]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:49 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 Sep 23 00:26:49 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:50 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734" returned: 0 in 0.734s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:50 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e Sep 23 00:26:50 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3465919c-3b8f-48c7-9659-43db466edbc5 tempest-VolumesTransfersV355Test-397215392 None] Transfer volume completed successfully. Sep 23 00:26:50 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e" returned: 0 in 0.589s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:50 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e Sep 23 00:26:50 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734.1c1dbfc6-7e00-4169-beaf-9626cfcf046e" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-1c1dbfc6-7e00-4169-beaf-9626cfcf046e" released by "_delete_snapshot" :: held 2.342s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-3fdc7459-71a7-41cf-8738-877cdeb5a734" released by "delete_snapshot" :: held 2.390s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Created reservations ['b9636715-95a5-4c4f-b3c4-c82f73b94324', 'cee46498-1425-4524-8185-3348ef9fd151', '26dea7a2-b715-403d-bb42-8a4eaa8e23b0', '021e04fc-e8be-416a-a4df-1cb9f9241309', '18975313-5b93-4d7f-9256-ea80285e5e14'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Acquiring lock "cinder-e07daaa8-80e3-44bd-803c-bdcc51fd313b-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Delete snapshot completed successfully. Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-e07daaa8-80e3-44bd-803c-bdcc51fd313b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-1c1dbfc6-7e00-4169-beaf-9626cfcf046e-delete_snapshot" released by "delete_snapshot" :: held 2.701s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Snapshots deleted, issuing volume delete {{(pid=87292) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-3fdc7459-71a7-41cf-8738-877cdeb5a734" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-3fdc7459-71a7-41cf-8738-877cdeb5a734" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Acquiring lock "cinder-quobyte-e07daaa8-80e3-44bd-803c-bdcc51fd313b" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a80201-e1f3-4172-82e0-954cf86071a3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-quobyte-e07daaa8-80e3-44bd-803c-bdcc51fd313b" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[889cdfc5-d04e-4427-b497-7a7fec4fdf63]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 Sep 23 00:26:51 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b Sep 23 00:26:51 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734 Sep 23 00:26:52 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b" returned: 0 in 0.585s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b Sep 23 00:26:52 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3fdc7459-71a7-41cf-8738-877cdeb5a734" returned: 0 in 0.319s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-3fdc7459-71a7-41cf-8738-877cdeb5a734" released by "delete_volume" :: held 0.945s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Created reservations ['455da30f-cb00-453a-9199-6b28bb97c867', 'f160770d-fd38-4d72-ac07-b1a8cd31bfd0', '6590eeec-37c1-4dbe-8984-de36f1382c35', '6ef489f4-9705-4291-a8f6-e0baf9cd2b22', 'a01ef91f-e405-4d13-ae8f-3cdf417e2aec'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:52 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e07daaa8-80e3-44bd-803c-bdcc51fd313b" returned: 0 in 0.332s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-quobyte-e07daaa8-80e3-44bd-803c-bdcc51fd313b" released by "delete_volume" :: held 0.999s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:52 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Created reservations ['7653bcd6-506a-4a1c-b10e-3dd8db55ee8a', 'f9da20c1-cd00-46fa-944c-7b87d6ccb9c4', '48146492-500a-4cf0-b85a-36e107a1b5bc', '937f12f4-15c7-4452-b646-fd7a64493f11', '3a928b1a-9a0d-4bdb-8e8e-5e111e7883f3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:52 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:52 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Deleted volume successfully. Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-56ab217c-38e6-4304-a58f-b8b8faed472f tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-3fdc7459-71a7-41cf-8738-877cdeb5a734-delete_volume" released by "delete_volume" :: held 4.349s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:53 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.296s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Deleted volume successfully. Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ffec47d1-380b-424f-ba79-ab45334e938b tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-e07daaa8-80e3-44bd-803c-bdcc51fd313b-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-90a2853a-215d-4d9b-8ecc-93b26ae34a8f-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-90a2853a-215d-4d9b-8ecc-93b26ae34a8f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "cinder-quobyte-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" acquired by "delete_volume" :: waited 0.058s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b7c3c7-d9d7-49f0-9518-cca7a4b5a186]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f Sep 23 00:26:53 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" returned: 0 in 0.544s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f Sep 23 00:26:54 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Flow 'volume_create_manager' (40bb7a80-36ec-44ce-8f51-8d2b00530e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3484c0c8-2a2e-4da7-8a29-0da31833d312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" returned: 0 in 0.461s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3484c0c8-2a2e-4da7-8a29-0da31833d312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128266050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5761aa38-613b-4e21-9e10-ad07361a32c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2149292c6f41838c0798be22d1464c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:54Z,use_quota=True,user_id='2cf014247f394b4a89919a719b2440ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980e5b1f-6dd9-47a5-832b-131aafb13603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980e5b1f-6dd9-47a5-832b-131aafb13603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e52f05-d88e-4ef0-ae51-df0e537405dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e52f05-d88e-4ef0-ae51-df0e537405dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5761aa38-613b-4e21-9e10-ad07361a32c6', 'volume_name': 'volume-5761aa38-613b-4e21-9e10-ad07361a32c6', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198f388b-ee05-4302-af84-42338bb77da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198f388b-ee05-4302-af84-42338bb77da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e310043a-8eb2-493d-bfe3-a93f382ef0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Volume 5761aa38-613b-4e21-9e10-ad07361a32c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5761aa38-613b-4e21-9e10-ad07361a32c6', 'volume_size': 1} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128266050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5761aa38-613b-4e21-9e10-ad07361a32c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2149292c6f41838c0798be22d1464c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:54Z,use_quota=True,user_id='2cf014247f394b4a89919a719b2440ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Creating volume 5761aa38-613b-4e21-9e10-ad07361a32c6 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:54 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-quobyte-90a2853a-215d-4d9b-8ecc-93b26ae34a8f" released by "delete_volume" :: held 1.192s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:54 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 1073741824 Sep 23 00:26:54 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Created reservations ['7d38ae72-0745-49ea-a7d1-d2b13a43e7da', '68d91675-0bcd-45f6-b6e9-3494901c17cf', '573d048e-a7fe-48ec-9ee1-6e57e42672bb', '1513078b-2814-4d2d-819e-951cb3bf5248', '6785a6b0-0cb3-49de-86de-da4ef397782e'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:54 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:55 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.351s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:55 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Deleted volume successfully. Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5f2075c6-82df-48ef-a341-bf352d5eaa76 tempest-VolumesDeleteCascade-1029092147 None] Lock "cinder-90a2853a-215d-4d9b-8ecc-93b26ae34a8f-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:55 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 1073741824" returned: 0 in 0.682s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 Sep 23 00:26:55 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.464s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:26:55 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6" returned: 0 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e310043a-8eb2-493d-bfe3-a93f382ef0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5761aa38-613b-4e21-9e10-ad07361a32c6', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ddac60-6486-4d1e-aa96-8e7a0913020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:55 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Volume volume-5761aa38-613b-4e21-9e10-ad07361a32c6 (5761aa38-613b-4e21-9e10-ad07361a32c6): created successfully Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ddac60-6486-4d1e-aa96-8e7a0913020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Flow 'volume_create_manager' (40bb7a80-36ec-44ce-8f51-8d2b00530e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:55 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f5aeac15-8358-473a-9f39-82a2509f6c0d tempest-VolumesTransfersV355Test-295391129 None] Created volume successfully. Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Acquiring lock "cinder-5761aa38-613b-4e21-9e10-ad07361a32c6-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-5761aa38-613b-4e21-9e10-ad07361a32c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Acquiring lock "cinder-quobyte-5761aa38-613b-4e21-9e10-ad07361a32c6" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-quobyte-5761aa38-613b-4e21-9e10-ad07361a32c6" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[99296820-4d82-4776-9268-71e8691c785b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 Sep 23 00:26:57 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6" returned: 0 in 0.510s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6 Sep 23 00:26:57 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-5761aa38-613b-4e21-9e10-ad07361a32c6" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-quobyte-5761aa38-613b-4e21-9e10-ad07361a32c6" released by "delete_volume" :: held 0.967s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Created reservations ['d8208289-b78a-4fbd-b482-9fd22326bd90', 'd79a86c4-5892-492b-9d05-e6a3cbeb5e73', '5b4ac269-53f1-48eb-8e1e-e04a59701b43', 'fbcd284b-ce48-4109-a0bf-ffac05177401', '15959b05-bf7e-4edc-9bd7-3576581cfe67'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:26:58 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.327s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Deleted volume successfully. Sep 23 00:26:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-65a08d87-f80f-4d44-99aa-938fc6ac340c tempest-VolumesTransfersV355Test-1111135735 None] Lock "cinder-5761aa38-613b-4e21-9e10-ad07361a32c6-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Flow 'volume_create_manager' (77baa0ea-9263-4ea1-971f-6740de8bcdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58515754-65e2-4976-9dfe-0f45f59ff6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58515754-65e2-4976-9dfe-0f45f59ff6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2127242566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f418e5-60a8-4f49-9d1f-b3d212022089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd20d9c9d1446eca1859b47b0fad125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:03Z,use_quota=True,user_id='2652216827c1400c9f736facafef1332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2201338-3439-4c11-8d35-4d25febef056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2201338-3439-4c11-8d35-4d25febef056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ae8b36-e3ef-4abf-a21a-0e009efccae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ae8b36-e3ef-4abf-a21a-0e009efccae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f418e5-60a8-4f49-9d1f-b3d212022089', 'volume_name': 'volume-b0f418e5-60a8-4f49-9d1f-b3d212022089', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae68ca54-393f-4ecb-8e54-00dbb9663131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae68ca54-393f-4ecb-8e54-00dbb9663131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b569ebe3-e545-4fed-8042-024de21a9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Volume b0f418e5-60a8-4f49-9d1f-b3d212022089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f418e5-60a8-4f49-9d1f-b3d212022089', 'volume_size': 1} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2127242566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f418e5-60a8-4f49-9d1f-b3d212022089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd20d9c9d1446eca1859b47b0fad125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:03Z,use_quota=True,user_id='2652216827c1400c9f736facafef1332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Creating volume b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:02 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:27:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:02 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 1073741824 Sep 23 00:27:02 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:03 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 1073741824" returned: 0 in 0.736s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:03 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 Sep 23 00:27:03 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:04 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089" returned: 0 in 0.442s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b569ebe3-e545-4fed-8042-024de21a9185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f418e5-60a8-4f49-9d1f-b3d212022089', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db416a9d-8423-4d19-8387-bc5e1121267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Volume volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 (b0f418e5-60a8-4f49-9d1f-b3d212022089): created successfully Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db416a9d-8423-4d19-8387-bc5e1121267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Flow 'volume_create_manager' (77baa0ea-9263-4ea1-971f-6740de8bcdd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-35f4c427-f5b8-471d-962f-7bd90def6895 tempest-TestImageHashVerification-2000925091 None] Created volume successfully. Sep 23 00:27:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c690aa-8571-4caa-9791-4d61e250c6e9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:06 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 Sep 23 00:27:06 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089" returned: 0 in 0.576s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae7f384-2822-4c67-89ce-9c5dbe6d706b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 Sep 23 00:27:07 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089" returned: 0 in 0.538s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 /opt/stack/data/cinder/conversion/b0f418e5-60a8-4f49-9d1f-b3d212022089.temp_image.c458cada-1121-49b5-b1f1-8ad5742d2822i0y1yj3g.img {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 /opt/stack/data/cinder/conversion/b0f418e5-60a8-4f49-9d1f-b3d212022089.temp_image.c458cada-1121-49b5-b1f1-8ad5742d2822i0y1yj3g.img Sep 23 00:27:07 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Flow 'volume_create_manager' (728dfe37-d013-40bb-8cf8-db210a29a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b53954f-6dd2-42a2-af37-116badd8b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b53954f-6dd2-42a2-af37-116badd8b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-187819819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea14a298-24f8-49f8-b71e-7c56afac33dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3417eba56694618a4471829c0495ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:08Z,use_quota=True,user_id='21f0a97351d8483fa3d54df70ad8659d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36e36ce-2b71-4b54-b4a8-0d896615ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36e36ce-2b71-4b54-b4a8-0d896615ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5662657-7d00-4d35-b263-4c30bd407591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5662657-7d00-4d35-b263-4c30bd407591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea14a298-24f8-49f8-b71e-7c56afac33dc', 'volume_name': 'volume-ea14a298-24f8-49f8-b71e-7c56afac33dc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1f3153-b0b8-4500-ae9e-5bab94419dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1f3153-b0b8-4500-ae9e-5bab94419dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f818bee-0896-4bc1-bf67-f98b7b1fd8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Volume ea14a298-24f8-49f8-b71e-7c56afac33dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea14a298-24f8-49f8-b71e-7c56afac33dc', 'volume_size': 1} Sep 23 00:27:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Flow 'volume_create_manager' (32f860c0-7e99-4656-a900-cddc0948fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0b07bc-bb12-4a75-90fe-e6220e831052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0b07bc-bb12-4a75-90fe-e6220e831052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-892964893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686f3b2c-3bb8-4831-8b69-b97177843d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c0a4a8fd56416e9da319b8a4f1abae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:13Z,use_quota=True,user_id='0e9a1d51ff28470fb5408660fceddede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef248b7d-bad8-4afe-927f-7eaf1ca757c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef248b7d-bad8-4afe-927f-7eaf1ca757c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dc7150-b096-4577-830a-f3c3949ac813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dc7150-b096-4577-830a-f3c3949ac813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '686f3b2c-3bb8-4831-8b69-b97177843d8a', 'volume_name': 'volume-686f3b2c-3bb8-4831-8b69-b97177843d8a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb8db79-01a0-4a3a-b67b-9d8e690dbd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb8db79-01a0-4a3a-b67b-9d8e690dbd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ab0a96-e2ea-4cb5-9e78-955cb78b2017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Volume 686f3b2c-3bb8-4831-8b69-b97177843d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-686f3b2c-3bb8-4831-8b69-b97177843d8a', 'volume_size': 1} Sep 23 00:27:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:14 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 /opt/stack/data/cinder/conversion/b0f418e5-60a8-4f49-9d1f-b3d212022089.temp_image.c458cada-1121-49b5-b1f1-8ad5742d2822i0y1yj3g.img" returned: 0 in 6.921s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5655b9-36d2-4804-ba4e-497fb7268153]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:15 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 Sep 23 00:27:15 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:15 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089" returned: 0 in 0.619s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:15 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/conversion/b0f418e5-60a8-4f49-9d1f-b3d212022089.temp_image.c458cada-1121-49b5-b1f1-8ad5742d2822i0y1yj3g.img {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:27:15 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Converted 1024.00 MB image at 147.94 MB/s Sep 23 00:27:15 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] c458cada-1121-49b5-b1f1-8ad5742d2822 was raw, no need to convert to raw {{(pid=87292) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:27:25 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:25 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:INSERT=17,cinder:SELECT=52,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.146s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Uploaded volume to glance image-id: c458cada-1121-49b5-b1f1-8ad5742d2822. {{(pid=87292) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.810s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-187819819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea14a298-24f8-49f8-b71e-7c56afac33dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3417eba56694618a4471829c0495ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:08Z,use_quota=True,user_id='21f0a97351d8483fa3d54df70ad8659d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Creating volume ea14a298-24f8-49f8-b71e-7c56afac33dc {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:35 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:27:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:35 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc 1073741824 Sep 23 00:27:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4716d6a7-6925-427b-9a31-529003cbb060 tempest-TestImageHashVerification-2000925091 None] Copy volume to image completed successfully. Sep 23 00:27:35 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:36 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc 1073741824" returned: 0 in 0.578s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc Sep 23 00:27:36 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Acquiring lock "cinder-b0f418e5-60a8-4f49-9d1f-b3d212022089-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Lock "cinder-b0f418e5-60a8-4f49-9d1f-b3d212022089-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Acquiring lock "cinder-quobyte-b0f418e5-60a8-4f49-9d1f-b3d212022089" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:36 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc" returned: 0 in 0.384s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Lock "cinder-quobyte-b0f418e5-60a8-4f49-9d1f-b3d212022089" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.547s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-892964893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686f3b2c-3bb8-4831-8b69-b97177843d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c0a4a8fd56416e9da319b8a4f1abae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:13Z,use_quota=True,user_id='0e9a1d51ff28470fb5408660fceddede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Creating volume 686f3b2c-3bb8-4831-8b69-b97177843d8a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:36 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7849ae5f-72ff-487a-9622-497fd5c68844]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a 1073741824 Sep 23 00:27:37 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f818bee-0896-4bc1-bf67-f98b7b1fd8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea14a298-24f8-49f8-b71e-7c56afac33dc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4431bf-464c-4125-aa12-d63e8478c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Volume volume-ea14a298-24f8-49f8-b71e-7c56afac33dc (ea14a298-24f8-49f8-b71e-7c56afac33dc): created successfully Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4431bf-464c-4125-aa12-d63e8478c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Flow 'volume_create_manager' (728dfe37-d013-40bb-8cf8-db210a29a455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-91f97c00-ae7b-402a-90c5-6a474ee3cbd9 tempest-VolumesNegativeTest-1720912016 None] Created volume successfully. Sep 23 00:27:37 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 Sep 23 00:27:37 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089" returned: 0 in 0.533s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a 1073741824" returned: 0 in 0.578s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089 Sep 23 00:27:37 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a Sep 23 00:27:37 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b0f418e5-60a8-4f49-9d1f-b3d212022089" returned: 0 in 0.364s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Lock "cinder-quobyte-b0f418e5-60a8-4f49-9d1f-b3d212022089" released by "delete_volume" :: held 0.973s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:37 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a" returned: 0 in 0.341s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ab0a96-e2ea-4cb5-9e78-955cb78b2017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-686f3b2c-3bb8-4831-8b69-b97177843d8a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92e0565-ec12-4e2a-b7ca-f2b2b22441dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Volume volume-686f3b2c-3bb8-4831-8b69-b97177843d8a (686f3b2c-3bb8-4831-8b69-b97177843d8a): created successfully Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92e0565-ec12-4e2a-b7ca-f2b2b22441dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Flow 'volume_create_manager' (32f860c0-7e99-4656-a900-cddc0948fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cbd64f80-3da3-4eea-a6a2-689ea92fb56c tempest-VolumesTransfersV357Test-703009827 None] Created volume successfully. Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Created reservations ['76c94da6-3bb8-4bed-adef-734a40f8416e', '05d4c0f8-e556-4117-9e0d-9ec17bf3bc79', 'd8f21994-316a-47d8-a323-4a159079fdce', 'ed59e4ef-0544-489f-b83c-a64a3fa6a6cd', 'c9ee3bb5-28e2-4422-b18f-15df9bc9ca94'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:38 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:27:38 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Deleted volume successfully. Sep 23 00:27:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-dcb8d035-8e56-43eb-8428-b2f87b28c004 tempest-TestImageHashVerification-2000925091 None] Lock "cinder-b0f418e5-60a8-4f49-9d1f-b3d212022089-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2b1df669-2121-4f28-92a5-506429d0e79a tempest-VolumesTransfersV357Test-1155063297 None] Transfer volume completed successfully. Sep 23 00:27:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Acquiring lock "cinder-686f3b2c-3bb8-4831-8b69-b97177843d8a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-686f3b2c-3bb8-4831-8b69-b97177843d8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Acquiring lock "cinder-quobyte-686f3b2c-3bb8-4831-8b69-b97177843d8a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-quobyte-686f3b2c-3bb8-4831-8b69-b97177843d8a" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:41 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8c4a04-345f-474d-b453-63615b1df401]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:41 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a Sep 23 00:27:41 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a" returned: 0 in 0.511s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a Sep 23 00:27:42 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-686f3b2c-3bb8-4831-8b69-b97177843d8a" returned: 0 in 0.348s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-quobyte-686f3b2c-3bb8-4831-8b69-b97177843d8a" released by "delete_volume" :: held 0.932s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Created reservations ['84bddd7f-904d-45df-8f41-936f9f904bd3', 'f0e78ab3-936b-4364-8963-64bd4ae90e3d', '95cb986f-2a00-40a3-a115-4af3024398c8', 'bcd704db-ec44-443f-ab55-1d9ce8bb39db', 'a7a30aa1-0600-4c6b-93ac-ceb088611dca'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:27:42 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.293s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Deleted volume successfully. Sep 23 00:27:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-423117ed-a9aa-4779-bdc2-0d5be6d7dcb3 tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-686f3b2c-3bb8-4831-8b69-b97177843d8a-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Flow 'volume_create_manager' (73c280d1-2ddc-434e-a645-810d31fb5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33bf0f3-e2fe-4e7e-9c6e-f5711b621f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33bf0f3-e2fe-4e7e-9c6e-f5711b621f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-674638712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fca805a-fc77-49b1-970a-75844f2b2d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c0a4a8fd56416e9da319b8a4f1abae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:44Z,use_quota=True,user_id='0e9a1d51ff28470fb5408660fceddede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3241ea6b-6f18-4463-8923-b8247539367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3241ea6b-6f18-4463-8923-b8247539367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca4f726-fa8f-401c-a85a-7c9350bf04c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca4f726-fa8f-401c-a85a-7c9350bf04c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fca805a-fc77-49b1-970a-75844f2b2d74', 'volume_name': 'volume-4fca805a-fc77-49b1-970a-75844f2b2d74', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552d1ed7-c96a-4d8b-991c-e3d3f006a8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552d1ed7-c96a-4d8b-991c-e3d3f006a8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd42314-fb10-4942-a203-ed0020cd1609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Volume 4fca805a-fc77-49b1-970a-75844f2b2d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fca805a-fc77-49b1-970a-75844f2b2d74', 'volume_size': 1} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-674638712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fca805a-fc77-49b1-970a-75844f2b2d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c0a4a8fd56416e9da319b8a4f1abae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:44Z,use_quota=True,user_id='0e9a1d51ff28470fb5408660fceddede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Creating volume 4fca805a-fc77-49b1-970a-75844f2b2d74 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:44 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:27:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:44 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 1073741824 Sep 23 00:27:44 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:45 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 1073741824" returned: 0 in 1.046s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:45 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 Sep 23 00:27:45 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74" returned: 0 in 0.537s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd42314-fb10-4942-a203-ed0020cd1609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fca805a-fc77-49b1-970a-75844f2b2d74', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f456f4-c216-416b-af2d-e19d7fe932de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Volume volume-4fca805a-fc77-49b1-970a-75844f2b2d74 (4fca805a-fc77-49b1-970a-75844f2b2d74): created successfully Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f456f4-c216-416b-af2d-e19d7fe932de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Flow 'volume_create_manager' (73c280d1-2ddc-434e-a645-810d31fb5630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-be55b7e9-0b9c-4e82-bf03-ed1fe4abac3f tempest-VolumesTransfersV357Test-703009827 None] Created volume successfully. Sep 23 00:27:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Acquiring lock "cinder-4fca805a-fc77-49b1-970a-75844f2b2d74-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-4fca805a-fc77-49b1-970a-75844f2b2d74-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Acquiring lock "cinder-quobyte-4fca805a-fc77-49b1-970a-75844f2b2d74" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-quobyte-4fca805a-fc77-49b1-970a-75844f2b2d74" acquired by "delete_volume" :: waited 0.045s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[290cae45-4d8b-49ac-ad28-cafb587810fa]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 Sep 23 00:27:47 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:48 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74" returned: 0 in 0.818s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:48 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74 Sep 23 00:27:48 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:49 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4fca805a-fc77-49b1-970a-75844f2b2d74" returned: 0 in 0.508s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-quobyte-4fca805a-fc77-49b1-970a-75844f2b2d74" released by "delete_volume" :: held 1.430s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Created reservations ['2219317a-5d55-4b4e-8a98-d8c49c2e42cd', '02283fbf-8b2e-4c7f-9bda-4f152262537b', 'a9d5b6f2-602e-42d0-a36c-90a350ab10cb', '9e3435f7-cf93-41fc-bfdd-d98ead966f30', '97775092-2876-48ec-b7c3-6e1d0f54c9e4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:49 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:27:49 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:49 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.381s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Deleted volume successfully. Sep 23 00:27:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6d5cad31-9954-4e06-abae-07bce1d8d89b tempest-VolumesTransfersV357Test-1443611764 None] Lock "cinder-4fca805a-fc77-49b1-970a-75844f2b2d74-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:54 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:55 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:27:55 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:55 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.361s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:27:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:27:59 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=37,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:59 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (9959a689-6bc2-4319-b635-eb2641d11022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd112520-bee2-472b-9284-3da3fa3bb2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd112520-bee2-472b-9284-3da3fa3bb2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-643684374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cf6f96-200b-4927-a09b-686a1129ee0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faec50e-28ca-4a7d-b95f-51099a9a33a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faec50e-28ca-4a7d-b95f-51099a9a33a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e5bad9-b010-4484-8f4e-300b9292957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e5bad9-b010-4484-8f4e-300b9292957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79cf6f96-200b-4927-a09b-686a1129ee0d', 'volume_name': 'volume-79cf6f96-200b-4927-a09b-686a1129ee0d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7270fe8f-755d-4da6-b54a-b5ec3926e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7270fe8f-755d-4da6-b54a-b5ec3926e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0e22d1-5e60-4cee-be28-0dbe0852e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Volume 79cf6f96-200b-4927-a09b-686a1129ee0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79cf6f96-200b-4927-a09b-686a1129ee0d', 'volume_size': 1} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-643684374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cf6f96-200b-4927-a09b-686a1129ee0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Creating volume 79cf6f96-200b-4927-a09b-686a1129ee0d {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:00 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:00 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d 1073741824 Sep 23 00:28:00 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (3e64bf55-24ab-4cff-ad22-fb96670204ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320e3e4e-55cd-458b-84a9-56ffc399e197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320e3e4e-55cd-458b-84a9-56ffc399e197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1596392935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deed25fe-35fa-4bd5-adcc-656cd6acf8ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac66c8cb-6c8a-49f6-8ca7-f830090524cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac66c8cb-6c8a-49f6-8ca7-f830090524cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc12cf7-1cb7-4bf6-8266-c3dc84935734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc12cf7-1cb7-4bf6-8266-c3dc84935734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deed25fe-35fa-4bd5-adcc-656cd6acf8ba', 'volume_name': 'volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4396519-3d1a-4eb5-93c5-53b462122d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4396519-3d1a-4eb5-93c5-53b462122d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ca1228-6fb7-4d8e-bf7e-f18d083f842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Volume deed25fe-35fa-4bd5-adcc-656cd6acf8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba', 'volume_size': 1} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (d1ed6f00-aec0-492d-8e19-d1d95a1e994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900f9b92-6944-4a9b-b802-96f3e2d69b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900f9b92-6944-4a9b-b802-96f3e2d69b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419318833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ff927-6acc-43ba-b9db-437184348c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:01Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b73558-77a5-4c18-bcca-ed2db9220baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b73558-77a5-4c18-bcca-ed2db9220baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa335a6a-2d59-4f6e-a6c3-24278fd27f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa335a6a-2d59-4f6e-a6c3-24278fd27f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1ff927-6acc-43ba-b9db-437184348c37', 'volume_name': 'volume-0e1ff927-6acc-43ba-b9db-437184348c37', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1432e7b-4a1f-4583-9ab6-d97b710b858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1432e7b-4a1f-4583-9ab6-d97b710b858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa869d70-be53-4870-89a1-400f961ba101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Volume 0e1ff927-6acc-43ba-b9db-437184348c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1ff927-6acc-43ba-b9db-437184348c37', 'volume_size': 1} Sep 23 00:28:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:01 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d 1073741824" returned: 0 in 0.852s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (952e119c-3072-4cd7-afdb-bf4eab300c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910421eb-4015-4602-996d-a08f2f97b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910421eb-4015-4602-996d-a08f2f97b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1179642660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f1c8af-f09a-4334-91a4-6e5767c63b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:01Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9479ffa1-bec5-4ab9-bb78-29e9109c9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9479ffa1-bec5-4ab9-bb78-29e9109c9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6157c8-5af4-48b4-b8e0-c5d9f9ae279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6157c8-5af4-48b4-b8e0-c5d9f9ae279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f1c8af-f09a-4334-91a4-6e5767c63b61', 'volume_name': 'volume-65f1c8af-f09a-4334-91a4-6e5767c63b61', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4a7111-88e4-4fe5-84f8-383260e0478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4a7111-88e4-4fe5-84f8-383260e0478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e0213f-b860-4e8e-af04-8723c8c44598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Volume 65f1c8af-f09a-4334-91a4-6e5767c63b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f1c8af-f09a-4334-91a4-6e5767c63b61', 'volume_size': 1} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:01 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d" returned: 0 in 0.361s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1596392935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deed25fe-35fa-4bd5-adcc-656cd6acf8ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Creating volume deed25fe-35fa-4bd5-adcc-656cd6acf8ba {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:01 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:01 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba 1073741824 Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0e22d1-5e60-4cee-be28-0dbe0852e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cf6f96-200b-4927-a09b-686a1129ee0d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923cc16a-d759-46a4-851e-575b8742335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Volume volume-79cf6f96-200b-4927-a09b-686a1129ee0d (79cf6f96-200b-4927-a09b-686a1129ee0d): created successfully Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923cc16a-d759-46a4-851e-575b8742335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (9959a689-6bc2-4319-b635-eb2641d11022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4a3f4dd1-f4b9-4215-8a38-1cb5bc96ab0d tempest-CreateVolumesFromImageTest-435796391 None] Created volume successfully. Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (b21bce4a-2eec-4602-8a39-7e02f42c8284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608b4459-7d24-4e36-8567-5bfe9f6e7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608b4459-7d24-4e36-8567-5bfe9f6e7b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940132145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30e2b66-50e3-467c-b26e-7e5f7c2b5c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05683f12-48b9-46b8-8131-d9ea7e8b8ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05683f12-48b9-46b8-8131-d9ea7e8b8ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2997ee2-a72a-437a-baf9-2602ed2b4442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2997ee2-a72a-437a-baf9-2602ed2b4442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30e2b66-50e3-467c-b26e-7e5f7c2b5c87', 'volume_name': 'volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd495f47-f9f8-479a-9d0c-96eff5bed6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd495f47-f9f8-479a-9d0c-96eff5bed6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2583eec7-1078-4ef5-a916-27166769b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Volume a30e2b66-50e3-467c-b26e-7e5f7c2b5c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87', 'volume_size': 1} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:02 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba 1073741824" returned: 0 in 0.845s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:02 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba Sep 23 00:28:02 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (2d398fab-fd27-4064-bbb6-3a13ea08973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3778878d-e2bd-40e1-b3f1-f4fa9be7a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3778878d-e2bd-40e1-b3f1-f4fa9be7a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-734965452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29219ca5-5b20-4b82-822a-f959fa04b1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27550462-2636-45b7-b5f0-8b3247930e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27550462-2636-45b7-b5f0-8b3247930e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da86720-9b7c-40ea-8b4a-4d506fdfdc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da86720-9b7c-40ea-8b4a-4d506fdfdc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29219ca5-5b20-4b82-822a-f959fa04b1b9', 'volume_name': 'volume-29219ca5-5b20-4b82-822a-f959fa04b1b9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5259ac2-d7c7-46ad-b4cc-95a4897f8b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5259ac2-d7c7-46ad-b4cc-95a4897f8b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a75e87-9b46-40b5-8a5f-c37585205b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Volume 29219ca5-5b20-4b82-822a-f959fa04b1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29219ca5-5b20-4b82-822a-f959fa04b1b9', 'volume_size': 1} Sep 23 00:28:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:03 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419318833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ff927-6acc-43ba-b9db-437184348c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:01Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Creating volume 0e1ff927-6acc-43ba-b9db-437184348c37 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:03 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 1073741824 Sep 23 00:28:03 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ca1228-6fb7-4d8e-bf7e-f18d083f842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096806ae-fff4-40c2-9df0-180e02291e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Volume volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba (deed25fe-35fa-4bd5-adcc-656cd6acf8ba): created successfully Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096806ae-fff4-40c2-9df0-180e02291e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (3e64bf55-24ab-4cff-ad22-fb96670204ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-37e430aa-f193-4db8-a121-d4938a194eb2 tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:28:03 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 1073741824" returned: 0 in 0.679s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 Sep 23 00:28:03 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37" returned: 0 in 0.372s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1179642660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f1c8af-f09a-4334-91a4-6e5767c63b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:01Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Creating volume 65f1c8af-f09a-4334-91a4-6e5767c63b61 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:04 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa869d70-be53-4870-89a1-400f961ba101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1ff927-6acc-43ba-b9db-437184348c37', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad0e3aa-df62-420f-a49b-ff0e9e6bf690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 1073741824 Sep 23 00:28:04 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Volume volume-0e1ff927-6acc-43ba-b9db-437184348c37 (0e1ff927-6acc-43ba-b9db-437184348c37): created successfully Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad0e3aa-df62-420f-a49b-ff0e9e6bf690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (d1ed6f00-aec0-492d-8e19-d1d95a1e994f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2e44aa5f-4de5-4a94-a2c1-ccd8741ff5f0 tempest-CreateVolumesFromImageTest-435796391 None] Created volume successfully. Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Acquiring lock "cinder-ea14a298-24f8-49f8-b71e-7c56afac33dc-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Lock "cinder-ea14a298-24f8-49f8-b71e-7c56afac33dc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (ec0f0b0b-fff8-4965-81b9-61b0e58397bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28243cce-2247-42b6-9f2f-3998b69d8cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28243cce-2247-42b6-9f2f-3998b69d8cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1581144733',display_name='tempest-VolumesGetTest-Volume-1248268431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbeeb29-ab78-4642-9e2a-6908f39997af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:04Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3330423-d0a1-4c83-9e28-6bd3bec40e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3330423-d0a1-4c83-9e28-6bd3bec40e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a52dd2a-bf48-402a-a247-14976becd951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a52dd2a-bf48-402a-a247-14976becd951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbeeb29-ab78-4642-9e2a-6908f39997af', 'volume_name': 'volume-0dbeeb29-ab78-4642-9e2a-6908f39997af', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740bbe0e-6499-44ab-ae64-e0546d988c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740bbe0e-6499-44ab-ae64-e0546d988c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579d23f4-65ba-4a54-8233-575b6cbef621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Volume 0dbeeb29-ab78-4642-9e2a-6908f39997af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbeeb29-ab78-4642-9e2a-6908f39997af', 'volume_size': 1} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Acquiring lock "cinder-quobyte-ea14a298-24f8-49f8-b71e-7c56afac33dc" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Lock "cinder-quobyte-ea14a298-24f8-49f8-b71e-7c56afac33dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205ecf2-1d0d-47b6-9133-f935e12ab453]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:04 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc Sep 23 00:28:04 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 1073741824" returned: 0 in 0.661s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:04 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 Sep 23 00:28:04 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc" returned: 0 in 0.460s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61" returned: 0 in 0.283s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940132145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30e2b66-50e3-467c-b26e-7e5f7c2b5c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Creating volume a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:05 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc Sep 23 00:28:05 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:05 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e0213f-b860-4e8e-af04-8723c8c44598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f1c8af-f09a-4334-91a4-6e5767c63b61', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a9f6f7-1361-41bd-a2ee-f4a9eebb70a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 1073741824 Sep 23 00:28:05 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Volume volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 (65f1c8af-f09a-4334-91a4-6e5767c63b61): created successfully Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a9f6f7-1361-41bd-a2ee-f4a9eebb70a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (952e119c-3072-4cd7-afdb-bf4eab300c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-68c54eec-69af-42f4-9238-1a29d6d0c0d8 tempest-CreateVolumesFromImageTest-435796391 None] Created volume successfully. Sep 23 00:28:05 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ea14a298-24f8-49f8-b71e-7c56afac33dc" returned: 0 in 0.281s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Lock "cinder-quobyte-ea14a298-24f8-49f8-b71e-7c56afac33dc" released by "delete_volume" :: held 0.793s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Created reservations ['d4f4f5ab-f1f5-472c-969e-4854a33205d7', '6f417bd1-42a0-4442-a256-2f269c1581ce', '114e6b8e-b84e-438c-b0cf-94a43fa35bd5', 'fb4d431e-2dfb-429c-8e47-1f34be5a7b1f', '4f7fbcb2-8085-4975-8914-abd12caa6862'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:05 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 1073741824" returned: 0 in 0.600s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 Sep 23 00:28:05 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.344s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Deleted volume successfully. Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ecbfa095-f158-4c27-b1df-58069e13074e tempest-VolumesNegativeTest-1720912016 None] Lock "cinder-ea14a298-24f8-49f8-b71e-7c56afac33dc-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:06 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87" returned: 0 in 0.281s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.285s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-734965452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29219ca5-5b20-4b82-822a-f959fa04b1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ec43c8f8654213ae700e1776d98f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='ce61eda2bb334e10808db3e18dbef546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Creating volume 29219ca5-5b20-4b82-822a-f959fa04b1b9 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:06 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2583eec7-1078-4ef5-a916-27166769b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da9a428-a8c3-427c-9700-866aa9289f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 1073741824 Sep 23 00:28:06 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Volume volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 (a30e2b66-50e3-467c-b26e-7e5f7c2b5c87): created successfully Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da9a428-a8c3-427c-9700-866aa9289f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (b21bce4a-2eec-4602-8a39-7e02f42c8284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4dbb765c-b3cc-4c1c-af80-24b50019a756 tempest-CreateVolumesFromImageTest-435796391 None] Created volume successfully. Sep 23 00:28:06 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 1073741824" returned: 0 in 0.500s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 Sep 23 00:28:06 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9" returned: 0 in 0.360s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.419s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1581144733',display_name='tempest-VolumesGetTest-Volume-1248268431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbeeb29-ab78-4642-9e2a-6908f39997af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:04Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Creating volume 0dbeeb29-ab78-4642-9e2a-6908f39997af {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:07 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a75e87-9b46-40b5-8a5f-c37585205b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29219ca5-5b20-4b82-822a-f959fa04b1b9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d20138-c669-4e2b-9276-aed09d334f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af 1073741824 Sep 23 00:28:07 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Volume volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 (29219ca5-5b20-4b82-822a-f959fa04b1b9): created successfully Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d20138-c669-4e2b-9276-aed09d334f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Flow 'volume_create_manager' (2d398fab-fd27-4064-bbb6-3a13ea08973c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a533eaf0-14ff-4215-99b4-2cbc3e4b89ce tempest-CreateVolumesFromImageTest-435796391 None] Created volume successfully. Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-29219ca5-5b20-4b82-822a-f959fa04b1b9-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-29219ca5-5b20-4b82-822a-f959fa04b1b9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-quobyte-29219ca5-5b20-4b82-822a-f959fa04b1b9" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-29219ca5-5b20-4b82-822a-f959fa04b1b9" acquired by "delete_volume" :: waited 0.027s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe4f92e-e691-452e-9823-f8e02594344f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 Sep 23 00:28:07 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af 1073741824" returned: 0 in 0.696s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af Sep 23 00:28:07 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:08 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9" returned: 0 in 0.503s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:08 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9 Sep 23 00:28:08 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:08 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579d23f4-65ba-4a54-8233-575b6cbef621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbeeb29-ab78-4642-9e2a-6908f39997af', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee12d42-b83c-4ccb-8a27-33343f1860b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Volume volume-0dbeeb29-ab78-4642-9e2a-6908f39997af (0dbeeb29-ab78-4642-9e2a-6908f39997af): created successfully Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee12d42-b83c-4ccb-8a27-33343f1860b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (ec0f0b0b-fff8-4965-81b9-61b0e58397bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-86d659c6-f50b-4d04-af68-42d1d386a2f9 tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:28:08 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-29219ca5-5b20-4b82-822a-f959fa04b1b9" returned: 0 in 0.371s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-29219ca5-5b20-4b82-822a-f959fa04b1b9" released by "delete_volume" :: held 0.939s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Created reservations ['ab772720-5a84-4552-8d81-1e9b96457c0f', '9b71d39d-3ad0-4799-9f29-0a9bfa4b2e9f', '509b4be4-0300-40b8-912c-4512d9342b70', '6b3818d9-c2e6-4fb6-86e4-d80b08f20866', 'a3ad7833-240d-4227-87c3-38e6f4509815'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:08 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:08 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-0dbeeb29-ab78-4642-9e2a-6908f39997af-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Lock "cinder-0dbeeb29-ab78-4642-9e2a-6908f39997af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-0dbeeb29-ab78-4642-9e2a-6908f39997af" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:09 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.412s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-0dbeeb29-ab78-4642-9e2a-6908f39997af" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Deleted volume successfully. Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8df076-4c4a-4049-8fde-effe2a7e6576]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65686b5-ca43-4847-9e12-d085369299bc tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-29219ca5-5b20-4b82-822a-f959fa04b1b9-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:09 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af Sep 23 00:28:09 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:09 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af Sep 23 00:28:09 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-quobyte-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f2f8c1-0789-409b-aae3-a8244b228ba4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0dbeeb29-ab78-4642-9e2a-6908f39997af" returned: 0 in 0.375s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-0dbeeb29-ab78-4642-9e2a-6908f39997af" released by "delete_volume" :: held 0.899s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:10 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 Sep 23 00:28:10 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Created reservations ['7bbef238-aded-43b2-8fcd-f0b6a8a50bde', 'ca63bdbc-7c09-4fe6-97e3-9b0f10347468', '4837fe7b-2d13-472b-b911-3b39d245f93d', 'cab065bf-10db-4f5e-a6d8-22045d1b53bb', 'c872f2d9-9a5e-48aa-b163-2a7f12a00313'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:10 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:10 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:10 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87" returned: 0 in 0.530s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:10 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87 Sep 23 00:28:10 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:10 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.369s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bef538b4-c0a0-4d8b-8533-ea4fff8dd1f9 tempest-VolumesGetTest-642283079 None] Lock "cinder-0dbeeb29-ab78-4642-9e2a-6908f39997af-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:10 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87" returned: 0 in 0.344s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87" released by "delete_volume" :: held 0.928s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Created reservations ['ac12b984-15d5-4432-b519-5a1c7875397a', '0433e69f-000b-4d58-901f-80d27178b287', '7276bfd4-6f2b-41b3-9d1c-f80305d69cca', '51ad0302-95e3-4a7a-ad5b-dd8e9ff9a91d', '090bebdf-671a-4622-baee-e2746ce750c1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:11 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:11 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:11 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Deleted volume successfully. Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2bdfaee7-724a-41d8-8d57-b2d9d2fab483 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-a30e2b66-50e3-467c-b26e-7e5f7c2b5c87-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-deed25fe-35fa-4bd5-adcc-656cd6acf8ba-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Lock "cinder-deed25fe-35fa-4bd5-adcc-656cd6acf8ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-deed25fe-35fa-4bd5-adcc-656cd6acf8ba" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-deed25fe-35fa-4bd5-adcc-656cd6acf8ba" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1a06a6-45f6-4041-9c64-57af58fe89cf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:11 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba Sep 23 00:28:11 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba" returned: 0 in 0.467s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-65f1c8af-f09a-4334-91a4-6e5767c63b61-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:12 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-65f1c8af-f09a-4334-91a4-6e5767c63b61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:12 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-quobyte-65f1c8af-f09a-4334-91a4-6e5767c63b61" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-65f1c8af-f09a-4334-91a4-6e5767c63b61" acquired by "delete_volume" :: waited 0.014s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bb2bc9-2fc3-4cf2-b200-e8ab67180bc7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 Sep 23 00:28:12 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-deed25fe-35fa-4bd5-adcc-656cd6acf8ba" returned: 0 in 0.347s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-deed25fe-35fa-4bd5-adcc-656cd6acf8ba" released by "delete_volume" :: held 0.872s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Created reservations ['815ca43a-bce3-4b3c-afb4-0794beb78823', 'a6638202-78cb-40fd-841f-8dc909f9662b', '61c5af20-5b39-422a-8aba-d72e57dfad8b', '694184ab-a2e4-4463-a8e8-85bb74bf7781', 'c28fd055-46cc-43e8-9e99-155fca6df64f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:12 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61" returned: 0 in 0.522s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61 Sep 23 00:28:12 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.348s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c0f2851f-b3ac-4cf8-9c5a-6010d2407b71 tempest-VolumesGetTest-642283079 None] Lock "cinder-deed25fe-35fa-4bd5-adcc-656cd6acf8ba-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:13 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-65f1c8af-f09a-4334-91a4-6e5767c63b61" returned: 0 in 0.382s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-65f1c8af-f09a-4334-91a4-6e5767c63b61" released by "delete_volume" :: held 0.969s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Created reservations ['944853eb-ab6d-4b0e-b636-5782fe8c0060', '0f15c172-7f27-44dd-ab5d-60c220c757f7', 'eb34aa7f-5bf8-45c0-8a47-be3127891693', '51a5b148-4bd5-4f61-b366-a413b1c0d3d8', 'c2a368f2-4d04-4623-9c8f-803436bacab9'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:13 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:13 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (762aeee4-101c-4c9f-a058-e781efbc5c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2712980-9ce2-42b0-b0c6-4ce84835aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2712980-9ce2-42b0-b0c6-4ce84835aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1885296584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd67bef-465a-4c43-8ee4-3d23589dd737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:13Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca75152-a7fa-4724-bdbc-8ce48af10d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca75152-a7fa-4724-bdbc-8ce48af10d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f622e0-4f9d-4b0f-af66-0e320611f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f622e0-4f9d-4b0f-af66-0e320611f536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd67bef-465a-4c43-8ee4-3d23589dd737', 'volume_name': 'volume-7dd67bef-465a-4c43-8ee4-3d23589dd737', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cc5fcd-eb27-4797-9c5c-2a01ff20f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cc5fcd-eb27-4797-9c5c-2a01ff20f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860201bb-1606-4195-bac1-e3517aa48d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Volume 7dd67bef-465a-4c43-8ee4-3d23589dd737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd67bef-465a-4c43-8ee4-3d23589dd737', 'volume_size': 1} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1885296584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd67bef-465a-4c43-8ee4-3d23589dd737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:13Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Creating volume 7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:13 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:13 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:13 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 1073741824 Sep 23 00:28:13 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Deleted volume successfully. Sep 23 00:28:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f14855fb-a1a3-4af4-acd2-b091f8676090 tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-65f1c8af-f09a-4334-91a4-6e5767c63b61-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:14 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 1073741824" returned: 0 in 0.502s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 Sep 23 00:28:14 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-0e1ff927-6acc-43ba-b9db-437184348c37-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-0e1ff927-6acc-43ba-b9db-437184348c37-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-quobyte-0e1ff927-6acc-43ba-b9db-437184348c37" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-0e1ff927-6acc-43ba-b9db-437184348c37" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ccc5a-60b3-46cd-9d90-9126d7278b63]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737" returned: 0 in 0.405s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860201bb-1606-4195-bac1-e3517aa48d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd67bef-465a-4c43-8ee4-3d23589dd737', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6774c714-138f-4a0a-836b-affdeef0f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:14 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Volume volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 (7dd67bef-465a-4c43-8ee4-3d23589dd737): created successfully Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6774c714-138f-4a0a-836b-affdeef0f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (762aeee4-101c-4c9f-a058-e781efbc5c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d98d56fe-4c9a-4a0f-b7dc-5324da9ffce7 tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:28:14 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 Sep 23 00:28:14 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37" returned: 0 in 0.521s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37 Sep 23 00:28:15 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0e1ff927-6acc-43ba-b9db-437184348c37" returned: 0 in 0.291s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-0e1ff927-6acc-43ba-b9db-437184348c37" released by "delete_volume" :: held 0.876s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Created reservations ['165a307a-65b9-45c3-ac5f-3bc04c90c649', 'a9b3ea57-6679-4f53-9364-bd5d47c16d57', 'c23bc9e2-47f8-4a49-92f5-98fb79a53eb8', '1560e919-c2a2-4bf9-beaf-74175ee5d0cb', 'b0823b6a-bfd5-4d06-a86f-494760c44336'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:15 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-79cf6f96-200b-4927-a09b-686a1129ee0d-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-79cf6f96-200b-4927-a09b-686a1129ee0d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "cinder-quobyte-79cf6f96-200b-4927-a09b-686a1129ee0d" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-79cf6f96-200b-4927-a09b-686a1129ee0d" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c2c6a0-452e-4acf-9b89-e488fb25cd4c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.365s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Deleted volume successfully. Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9c4ed24f-5b8b-4d5b-a88c-9657a56ba11b tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-0e1ff927-6acc-43ba-b9db-437184348c37-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:16 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d Sep 23 00:28:16 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:16 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d" returned: 0 in 0.725s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d Sep 23 00:28:16 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (12052f14-be41-4b78-9fc6-eb4af144e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1a304a-12e1-4661-b230-d80cdf068ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1a304a-12e1-4661-b230-d80cdf068ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1518274907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6a9104-b07a-4f23-971c-a16bd6ea7440,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7dd67bef-465a-4c43-8ee4-3d23589dd737,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:16Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7638906d-7419-4e61-aa5f-3a94d723f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7638906d-7419-4e61-aa5f-3a94d723f344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31e5fb1-683a-4ec8-bd51-ade6f368fb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31e5fb1-683a-4ec8-bd51-ade6f368fb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae6a9104-b07a-4f23-971c-a16bd6ea7440', 'volume_name': 'volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440', 'volume_size': 1, 'source_volid': '7dd67bef-465a-4c43-8ee4-3d23589dd737', 'source_volstatus': 'available'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73714309-0268-45bc-8ae8-032349ce4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73714309-0268-45bc-8ae8-032349ce4161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54b02bd-de07-40e9-ba58-0b40d13fa246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:16 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Volume ae6a9104-b07a-4f23-971c-a16bd6ea7440: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440', 'volume_size': 1, 'source_volid': '7dd67bef-465a-4c43-8ee4-3d23589dd737', 'source_volstatus': 'available'} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:16 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Cloning volume 7dd67bef-465a-4c43-8ee4-3d23589dd737 to volume ae6a9104-b07a-4f23-971c-a16bd6ea7440 Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Creating offline snapshot 0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c of volume 7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1532ad-2b44-4864-9b37-445b6dd2cc11]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 Sep 23 00:28:16 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-79cf6f96-200b-4927-a09b-686a1129ee0d" returned: 0 in 0.398s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-quobyte-79cf6f96-200b-4927-a09b-686a1129ee0d" released by "delete_volume" :: held 1.197s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Created reservations ['c31fb23e-5123-4eeb-9007-0e5260ce7dc1', '54f05de6-e440-4201-abfd-283ba43703c3', 'dd09dbf6-1f1c-418f-b4fb-16fa89599fa9', '19fb86fe-fe54-4ccd-9f48-abc2527c948d', '1afb63b8-4b8f-41f4-a699-28b7bc4c7cd3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:17 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737" returned: 0 in 0.494s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c 1G Sep 23 00:28:17 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Deleted volume successfully. Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-57354ee9-4a1a-48a2-84c6-cca819f8956d tempest-CreateVolumesFromImageTest-435796391 None] Lock "cinder-79cf6f96-200b-4927-a09b-686a1129ee0d-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:17 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c 1G" returned: 0 in 0.495s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c Sep 23 00:28:17 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:18 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" returned: 0 in 0.438s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:18 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c is being set with open permissions: ugo+rw Sep 23 00:28:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:18 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c Sep 23 00:28:18 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:18 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" returned: 0 in 0.366s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:18 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info Sep 23 00:28:18 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:19 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info" returned: 0 in 0.400s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:19 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info is being set with open permissions: ugo+rw Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:19 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info Sep 23 00:28:19 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:19 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.info" returned: 0 in 0.356s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-ae6a9104-b07a-4f23-971c-a16bd6ea7440" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-ae6a9104-b07a-4f23-971c-a16bd6ea7440" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] snapshot: 0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c, volume: ae6a9104-b07a-4f23-971c-a16bd6ea7440, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91eb6c1-8d0b-48c9-a6ce-f439fc26b800]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:19 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c Sep 23 00:28:19 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:20 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd67bef-465a-4c43-8ee4-3d23589dd737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab5f84-72f2-4de0-98de-e185ccf487ee]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:20 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 Sep 23 00:28:20 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:20 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737" returned: 0 in 0.484s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:28:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:20 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 Sep 23 00:28:20 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (3538608f-1d5a-4fc6-b01f-e04063bf5c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f11e847-7f9a-4b30-a957-0ad8ffdf1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f11e847-7f9a-4b30-a957-0ad8ffdf1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785839514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d30a1ff-dd7d-4857-a60f-be32e5ba7365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:23Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497eba9-569f-42ad-b28a-f9cde08cae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497eba9-569f-42ad-b28a-f9cde08cae58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2056ca06-81d9-4cc5-a00d-fcc5a5a63d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2056ca06-81d9-4cc5-a00d-fcc5a5a63d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d30a1ff-dd7d-4857-a60f-be32e5ba7365', 'volume_name': 'volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5c0e11-e022-482c-b68b-33aebf641742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5c0e11-e022-482c-b68b-33aebf641742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97385b0a-e3c4-4f11-841e-fff289a0f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume 8d30a1ff-dd7d-4857-a60f-be32e5ba7365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365', 'volume_size': 1} Sep 23 00:28:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:28 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=68,cinder:UPDATE=103,cinder:DELETE=7,cinder:INSERT=27 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:28 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440" returned: 0 in 8.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:28 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:28 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Converted 1024.00 MB image at 123.00 MB/s Sep 23 00:28:28 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 is being set with open permissions: ugo+rw Sep 23 00:28:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:28 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 Sep 23 00:28:28 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-ae6a9104-b07a-4f23-971c-a16bd6ea7440" released by "_copy_volume_from_snapshot" :: held 9.734s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Deleting offline snapshot 0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c of volume 7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] snapshot_file for this snap is: volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e9f0a-f197-4fd8-837b-f5729fe96ae3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c Sep 23 00:28:29 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (858e3b9a-7e22-44b9-87d1-f39b5b58ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b503b454-9b1b-4cf0-ad20-bdaa03651942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b503b454-9b1b-4cf0-ad20-bdaa03651942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-161795835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1486e941-0215-43a0-b993-cce4a77465fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:29Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b705c8-fdb5-46fc-b790-9d44e0deeabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b705c8-fdb5-46fc-b790-9d44e0deeabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27647b1a-ba6e-44e5-9445-dc8d477f3be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27647b1a-ba6e-44e5-9445-dc8d477f3be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1486e941-0215-43a0-b993-cce4a77465fa', 'volume_name': 'volume-1486e941-0215-43a0-b993-cce4a77465fa', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da36c92f-69ae-4115-8bc3-8173037dab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da36c92f-69ae-4115-8bc3-8173037dab7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057cb5be-bbdf-4725-b0e1-8a4075883c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Volume 1486e941-0215-43a0-b993-cce4a77465fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1486e941-0215-43a0-b993-cce4a77465fa', 'volume_size': 1} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:29 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd67bef-465a-4c43-8ee4-3d23589dd737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[94916cb5-48d5-4882-9dd7-0b67d3308979]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 Sep 23 00:28:29 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737" returned: 0 in 0.591s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c Sep 23 00:28:30 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" returned: 0 in 0.369s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c Sep 23 00:28:30 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737.0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" returned: 0 in 0.280s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-0ff3f2ae-e372-40a2-8af7-1ac71ae0d76c" released by "_delete_snapshot" :: held 1.806s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.353s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.900s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785839514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d30a1ff-dd7d-4857-a60f-be32e5ba7365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:23Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Creating volume 8d30a1ff-dd7d-4857-a60f-be32e5ba7365 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:31 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 1073741824 Sep 23 00:28:31 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54b02bd-de07-40e9-ba58-0b40d13fa246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440', 'volume_size': 1, 'source_volid': '7dd67bef-465a-4c43-8ee4-3d23589dd737', 'source_volstatus': 'available'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cedcfde-5c09-4fe4-9847-65dbbca84fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Volume volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 (ae6a9104-b07a-4f23-971c-a16bd6ea7440): created successfully Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cedcfde-5c09-4fe4-9847-65dbbca84fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (12052f14-be41-4b78-9fc6-eb4af144e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c87058fb-4bd4-4f76-a6f9-2d71e85dc8df tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:28:31 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 1073741824" returned: 0 in 0.566s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 Sep 23 00:28:31 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:32 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365" returned: 0 in 0.329s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-161795835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1486e941-0215-43a0-b993-cce4a77465fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:29Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Creating volume 1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:32 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97385b0a-e3c4-4f11-841e-fff289a0f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582b9029-3007-489d-bd6d-371cd8dbf5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa 1073741824 Sep 23 00:28:32 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:32 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 (8d30a1ff-dd7d-4857-a60f-be32e5ba7365): created successfully Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582b9029-3007-489d-bd6d-371cd8dbf5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (3538608f-1d5a-4fc6-b01f-e04063bf5c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:32 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-690e4d32-a724-47d8-8897-767e2077a846 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created volume successfully. Sep 23 00:28:32 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa 1073741824" returned: 0 in 0.596s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:32 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa Sep 23 00:28:32 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:33 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa" returned: 0 in 0.326s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057cb5be-bbdf-4725-b0e1-8a4075883c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1486e941-0215-43a0-b993-cce4a77465fa', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ee68d1-9f97-450d-a5bf-a0986b40c01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (6ed376f4-067e-43ef-891e-b3a9df25fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060c133b-d92b-4e39-a0f9-075473017b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Volume volume-1486e941-0215-43a0-b993-cce4a77465fa (1486e941-0215-43a0-b993-cce4a77465fa): created successfully Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ee68d1-9f97-450d-a5bf-a0986b40c01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (858e3b9a-7e22-44b9-87d1-f39b5b58ba85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060c133b-d92b-4e39-a0f9-075473017b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1203594098',display_name='tempest-VolumesGetTest-Volume-1768884935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a083631-d8e3-49f3-844e-2c3580810575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a083631-d8e3-49f3-844e-2c3580810575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedf1c38-79d8-46f5-ab98-ab542e1ea4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedf1c38-79d8-46f5-ab98-ab542e1ea4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd', 'volume_name': 'volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15248b4-630b-48f2-9ef3-d80a98706748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15248b4-630b-48f2-9ef3-d80a98706748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1050272-468d-4cf8-b6b0-a62e20b7258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Volume a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd', 'volume_size': 1} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1203594098',display_name='tempest-VolumesGetTest-Volume-1768884935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Creating volume a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:33 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c267dd19-7d1d-4f7a-92b0-8772087a6cf8 tempest-VolumesSnapshotTestJSON-480272213 None] Created volume successfully. Sep 23 00:28:33 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd 1073741824 Sep 23 00:28:33 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (a6f88b5c-a1eb-4b11-b19c-1981408aeb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77342f27-bc5e-4726-97ac-b36d97eaa73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77342f27-bc5e-4726-97ac-b36d97eaa73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1187842416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff48bc9c-b548-4f1c-b930-1b4a6ce182a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e7daa1-a48b-46d1-8326-0665f00c7245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e7daa1-a48b-46d1-8326-0665f00c7245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe41a4fa-ada6-4be4-9344-e17cc596c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe41a4fa-ada6-4be4-9344-e17cc596c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff48bc9c-b548-4f1c-b930-1b4a6ce182a7', 'volume_name': 'volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6ce4ca-1331-4f96-b1cb-c559c9e8bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6ce4ca-1331-4f96-b1cb-c559c9e8bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ed129-4ae7-48f6-8c3e-959d0523bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume ff48bc9c-b548-4f1c-b930-1b4a6ce182a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7', 'volume_size': 1} Sep 23 00:28:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:34 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd 1073741824" returned: 0 in 0.734s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (cb6a646a-ac31-466b-9f91-6dc765d1779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494ff6ec-c4ff-4497-b190-63832b309bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494ff6ec-c4ff-4497-b190-63832b309bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147499386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bda7aa-2ba0-42a9-8157-0add45259e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:34Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6129dc8-d13e-43fb-84d1-2b7686c4675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6129dc8-d13e-43fb-84d1-2b7686c4675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f074a9b1-9257-4e65-8656-388381eee24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f074a9b1-9257-4e65-8656-388381eee24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3bda7aa-2ba0-42a9-8157-0add45259e68', 'volume_name': 'volume-e3bda7aa-2ba0-42a9-8157-0add45259e68', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a699e059-c184-4e2e-b197-ffeb362d896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a699e059-c184-4e2e-b197-ffeb362d896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42596142-5f51-4b38-9fa8-5195d6420c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume e3bda7aa-2ba0-42a9-8157-0add45259e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3bda7aa-2ba0-42a9-8157-0add45259e68', 'volume_size': 1} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:34 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd Sep 23 00:28:34 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd" returned: 0 in 0.325s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1187842416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff48bc9c-b548-4f1c-b930-1b4a6ce182a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Creating volume ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:34 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1050272-468d-4cf8-b6b0-a62e20b7258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 1073741824 Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004087e0-d5d5-4b00-8ed6-19e0adae353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Volume volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd (a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd): created successfully Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004087e0-d5d5-4b00-8ed6-19e0adae353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (6ed376f4-067e-43ef-891e-b3a9df25fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ab504bdc-6ad5-4fbc-a903-4951f22f3766 tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (0d2d670c-4a45-4d8b-862b-dbe926b2ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96e82d1-8ffc-4d36-af72-5264e7ef0f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96e82d1-8ffc-4d36-af72-5264e7ef0f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799452104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8442ed-b6f5-4b66-a5df-3e8d33860913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:35Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fd73e2-adf9-42cc-8811-7ba01390e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fd73e2-adf9-42cc-8811-7ba01390e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29155bc1-8f73-4a61-9dd4-c7e1273001c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29155bc1-8f73-4a61-9dd4-c7e1273001c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8442ed-b6f5-4b66-a5df-3e8d33860913', 'volume_name': 'volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3d28f3-9ff1-414c-8fb6-4f4a57a93c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3d28f3-9ff1-414c-8fb6-4f4a57a93c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0985018a-ec91-44bb-a556-a2f4be2fd734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume 3a8442ed-b6f5-4b66-a5df-3e8d33860913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913', 'volume_size': 1} Sep 23 00:28:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (bfa38320-f6ff-4993-913e-a87a95f7c870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a39d84-f5b6-4a80-8e52-674238c145c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a39d84-f5b6-4a80-8e52-674238c145c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296785102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd1b576-1cfd-4486-822e-5688d18f0f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:35Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6630f732-bf8f-49f7-995b-92182ee147fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6630f732-bf8f-49f7-995b-92182ee147fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc9b145-1069-43e1-aef5-1a842900215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc9b145-1069-43e1-aef5-1a842900215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd1b576-1cfd-4486-822e-5688d18f0f15', 'volume_name': 'volume-cbd1b576-1cfd-4486-822e-5688d18f0f15', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe155665-204a-450b-b012-ed914e05f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe155665-204a-450b-b012-ed914e05f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843fba34-8e8d-4bc9-9202-00fcb820e717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume cbd1b576-1cfd-4486-822e-5688d18f0f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd1b576-1cfd-4486-822e-5688d18f0f15', 'volume_size': 1} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:35 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 1073741824" returned: 0 in 0.662s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 Sep 23 00:28:35 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Lock "cinder-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:35 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7" returned: 0 in 0.341s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc21097-66e1-407e-bb33-d182be99d5a2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147499386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bda7aa-2ba0-42a9-8157-0add45259e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:34Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Creating volume e3bda7aa-2ba0-42a9-8157-0add45259e68 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:35 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 1073741824 Sep 23 00:28:35 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ed129-4ae7-48f6-8c3e-959d0523bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ef7199-67c6-4b9e-a845-ac69e778e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 (ff48bc9c-b548-4f1c-b930-1b4a6ce182a7): created successfully Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ef7199-67c6-4b9e-a845-ac69e778e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (a6f88b5c-a1eb-4b11-b19c-1981408aeb2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3939f912-3304-42cb-8592-0aa1f7514d27 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created volume successfully. Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (a01c738f-3463-4c54-a602-2d2ce7bec577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15db34a0-9c73-4e7e-8b5c-43a095f56ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15db34a0-9c73-4e7e-8b5c-43a095f56ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439506470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd0016-410f-4a2b-bb5b-460a2bd08352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:36Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd Sep 23 00:28:35 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a63fde0-6cb2-4f4e-bf7b-04eebcefb37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a63fde0-6cb2-4f4e-bf7b-04eebcefb37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e802ff-7d9b-4356-a336-16a76c959af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e802ff-7d9b-4356-a336-16a76c959af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edd0016-410f-4a2b-bb5b-460a2bd08352', 'volume_name': 'volume-2edd0016-410f-4a2b-bb5b-460a2bd08352', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d7f62a-e820-447b-b507-c171a9084d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d7f62a-e820-447b-b507-c171a9084d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1f8ce7-27ac-439a-baff-d110ef4785ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume 2edd0016-410f-4a2b-bb5b-460a2bd08352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edd0016-410f-4a2b-bb5b-460a2bd08352', 'volume_size': 1} Sep 23 00:28:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd" returned: 0 in 0.430s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd Sep 23 00:28:36 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 1073741824" returned: 0 in 0.477s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 Sep 23 00:28:36 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd" returned: 0 in 0.331s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd" released by "delete_volume" :: held 0.844s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:36 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.691s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Creating offline snapshot 37a1d734-4818-40c8-88d4-3c143d3aad04 of volume 1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42596142-5f51-4b38-9fa8-5195d6420c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bda7aa-2ba0-42a9-8157-0add45259e68', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9aafee-f215-4eb7-b4f5-b18edd412c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[307382ff-d7cd-4b04-9762-8136bd7ff8f1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 (e3bda7aa-2ba0-42a9-8157-0add45259e68): created successfully Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9aafee-f215-4eb7-b4f5-b18edd412c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (cb6a646a-ac31-466b-9f91-6dc765d1779b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2c52cfa8-7b77-43c1-9db0-eb72cb6ff318 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created volume successfully. Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Created reservations ['d4d0e36c-128e-46de-9367-0ac337d65447', 'a8261348-2641-40cf-a41c-894f7852824f', 'd7ae104d-ca39-40a4-b63f-f2ce40c5d21f', 'e8270494-464c-456c-8320-7c3133fe6f2a', '52c012cd-ffaf-4ed4-bf67-94ad6ff3493b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:36 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa Sep 23 00:28:36 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:36 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 1G Sep 23 00:28:36 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.314s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0f2db72d-7ecd-4966-bf5e-de152d59d270 tempest-VolumesGetTest-642283079 None] Lock "cinder-a4e1b063-0f9c-4f64-ad2b-2e242d16b5fd-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:37 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 1G" returned: 0 in 0.490s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1486e941-0215-43a0-b993-cce4a77465fa -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1486e941-0215-43a0-b993-cce4a77465fa -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 Sep 23 00:28:37 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1486e941-0215-43a0-b993-cce4a77465fa -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04" returned: 0 in 0.343s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 is being set with open permissions: ugo+rw Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 Sep 23 00:28:37 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-ae6a9104-b07a-4f23-971c-a16bd6ea7440-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Lock "cinder-ae6a9104-b07a-4f23-971c-a16bd6ea7440-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-ae6a9104-b07a-4f23-971c-a16bd6ea7440" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-ae6a9104-b07a-4f23-971c-a16bd6ea7440" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e30af-95a8-4f88-8365-f609e5b601de]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04" returned: 0 in 0.299s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info Sep 23 00:28:38 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 Sep 23 00:28:38 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info is being set with open permissions: ugo+rw Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info Sep 23 00:28:38 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440" returned: 0 in 0.461s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440 Sep 23 00:28:38 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.info" returned: 0 in 0.310s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799452104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8442ed-b6f5-4b66-a5df-3e8d33860913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:35Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Creating volume 3a8442ed-b6f5-4b66-a5df-3e8d33860913 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:38 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 1073741824 Sep 23 00:28:38 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ae6a9104-b07a-4f23-971c-a16bd6ea7440" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-ae6a9104-b07a-4f23-971c-a16bd6ea7440" released by "delete_volume" :: held 0.834s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8884767b-51ae-4241-a1aa-63f6e8a3bcc5 tempest-VolumesSnapshotTestJSON-480272213 None] Create snapshot completed successfully Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Created reservations ['26b6f3df-d819-4583-8915-de7337c6a160', '0cf40bee-c47d-49be-b5fe-d8445c7a455f', '973aa94b-2ff5-46ac-99ab-643b113f2851', 'ca3730cc-efdf-490b-8285-20295e6045ef', '09a9cbb0-0cf4-4543-aeed-387b981cf2a6'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:39 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-7dd67bef-465a-4c43-8ee4-3d23589dd737-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Lock "cinder-7dd67bef-465a-4c43-8ee4-3d23589dd737-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-7dd67bef-465a-4c43-8ee4-3d23589dd737" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-7dd67bef-465a-4c43-8ee4-3d23589dd737" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94a4357-76cc-4d61-b938-629ad90dc750]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 1073741824" returned: 0 in 0.665s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.447s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:28:39 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 Sep 23 00:28:39 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ceefd30d-5abb-45d8-929c-d06ed12fee06 tempest-VolumesGetTest-642283079 None] Lock "cinder-ae6a9104-b07a-4f23-971c-a16bd6ea7440-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 Sep 23 00:28:39 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.543s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296785102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd1b576-1cfd-4486-822e-5688d18f0f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:35Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Creating volume cbd1b576-1cfd-4486-822e-5688d18f0f15 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:39 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 1073741824 Sep 23 00:28:39 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0985018a-ec91-44bb-a556-a2f4be2fd734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751e30dc-5e52-4324-8573-bba055fd3b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 (3a8442ed-b6f5-4b66-a5df-3e8d33860913): created successfully Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751e30dc-5e52-4324-8573-bba055fd3b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (0d2d670c-4a45-4d8b-862b-dbe926b2ec67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b0bc727d-05f6-4903-aeac-6c1eb8df9054 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created volume successfully. Sep 23 00:28:39 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737" returned: 0 in 0.535s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-37a1d734-4818-40c8-88d4-3c143d3aad04-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737 Sep 23 00:28:39 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-37a1d734-4818-40c8-88d4-3c143d3aad04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-1486e941-0215-43a0-b993-cce4a77465fa" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-1486e941-0215-43a0-b993-cce4a77465fa" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-37a1d734-4818-40c8-88d4-3c143d3aad04" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-37a1d734-4818-40c8-88d4-3c143d3aad04" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Deleting offline snapshot 37a1d734-4818-40c8-88d4-3c143d3aad04 of volume 1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] snapshot_file for this snap is: volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fb43f0-3994-4c33-8313-d3b73d382d97]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 Sep 23 00:28:40 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7dd67bef-465a-4c43-8ee4-3d23589dd737" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-7dd67bef-465a-4c43-8ee4-3d23589dd737" released by "delete_volume" :: held 0.993s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Created reservations ['aeaec737-c613-46e8-bc11-a4625f9bccd6', 'c14c6a07-265e-4e73-9039-d2b2406e92e2', '5541fa0d-dfc2-4612-893a-ccfeba18b67b', '43627af7-2dca-48c9-b15c-1e84f3276afc', '07729727-bbc7-4d51-9440-15f6c4361766'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:40 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 1073741824" returned: 0 in 0.665s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 Sep 23 00:28:40 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:40 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04" returned: 0 in 0.508s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1486e941-0215-43a0-b993-cce4a77465fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c6736-617e-43f8-a333-85c504e9538b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa Sep 23 00:28:40 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15" returned: 0 in 0.337s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.025s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439506470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd0016-410f-4a2b-bb5b-460a2bd08352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cbed3a9af0477085b29f4d377c58d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:36Z,use_quota=True,user_id='00c12688aaf4463095b58e8ea6d98e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Creating volume 2edd0016-410f-4a2b-bb5b-460a2bd08352 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:40 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843fba34-8e8d-4bc9-9202-00fcb820e717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd1b576-1cfd-4486-822e-5688d18f0f15', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:40 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 1073741824 Sep 23 00:28:40 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42d81fd-73b6-4954-89e1-8ed414fb1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 (cbd1b576-1cfd-4486-822e-5688d18f0f15): created successfully Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42d81fd-73b6-4954-89e1-8ed414fb1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (bfa38320-f6ff-4993-913e-a87a95f7c870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:40 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.358s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:28:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c7f88475-c50c-48fa-b28a-a7b87a94256f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created volume successfully. Sep 23 00:28:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ad8b2887-8d76-4286-82e8-24493bf84ef1 tempest-VolumesGetTest-642283079 None] Lock "cinder-7dd67bef-465a-4c43-8ee4-3d23589dd737-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:41 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa" returned: 0 in 0.489s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 Sep 23 00:28:41 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 1073741824" returned: 0 in 0.646s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 Sep 23 00:28:41 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04" returned: 0 in 0.475s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04 Sep 23 00:28:41 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352" returned: 0 in 0.326s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1f8ce7-27ac-439a-baff-d110ef4785ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edd0016-410f-4a2b-bb5b-460a2bd08352', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed121d0e-3007-4b88-9497-2eb8be84dd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:41 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Volume volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 (2edd0016-410f-4a2b-bb5b-460a2bd08352): created successfully Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed121d0e-3007-4b88-9497-2eb8be84dd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Flow 'volume_create_manager' (a01c738f-3463-4c54-a602-2d2ce7bec577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5fcb0f2a-fd78-4cc1-889b-a6639209a3d7 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created volume successfully. Sep 23 00:28:41 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa.37a1d734-4818-40c8-88d4-3c143d3aad04" returned: 0 in 0.361s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-37a1d734-4818-40c8-88d4-3c143d3aad04" released by "_delete_snapshot" :: held 2.025s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-1486e941-0215-43a0-b993-cce4a77465fa" released by "delete_snapshot" :: held 2.065s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['36344d99-c8ac-434b-9d4a-c03f10add277', '01386abc-6802-485e-ab14-9e799f796c80', 'd1e0aae0-9754-4cd6-a485-d31e826cdb2a', '0ce792f0-ec3a-4fb5-b8be-9d370a0a626d', 'acca3a41-e1bd-4317-ae1c-5415dc550eb1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Delete snapshot completed successfully. Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d7c8b1df-1a2c-4d34-b04c-57f12db6dd0d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-37a1d734-4818-40c8-88d4-3c143d3aad04-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (f644b02a-4813-4a74-a529-31dd5fecb9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503bddc8-36f6-4a7a-81aa-7cd4ce138716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503bddc8-36f6-4a7a-81aa-7cd4ce138716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144139497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec1ce11-6da1-40ea-abfd-f427c644a377,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:42Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11597859-c967-449f-a810-968d1055e5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11597859-c967-449f-a810-968d1055e5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c4f64-abeb-46b6-ab7d-4d79211a01a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-2edd0016-410f-4a2b-bb5b-460a2bd08352-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-2edd0016-410f-4a2b-bb5b-460a2bd08352-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-quobyte-2edd0016-410f-4a2b-bb5b-460a2bd08352" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-2edd0016-410f-4a2b-bb5b-460a2bd08352" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[228fc2c6-43bb-46e7-aa9b-5dbfcb397395]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 Sep 23 00:28:42 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c4f64-abeb-46b6-ab7d-4d79211a01a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eec1ce11-6da1-40ea-abfd-f427c644a377', 'volume_name': 'volume-eec1ce11-6da1-40ea-abfd-f427c644a377', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22eb0e19-1c17-49a4-beb8-e648b632501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22eb0e19-1c17-49a4-beb8-e648b632501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edef8da-6848-4eff-bba0-4380781f01f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:43 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Volume eec1ce11-6da1-40ea-abfd-f427c644a377: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eec1ce11-6da1-40ea-abfd-f427c644a377', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Trying to clone eec1ce11-6da1-40ea-abfd-f427c644a377 from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:28:43 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352" returned: 0 in 0.512s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:43 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352 Sep 23 00:28:43 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:28:43 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec53642-b5ad-41fb-bc84-d1a2692b9f39]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:43 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2edd0016-410f-4a2b-bb5b-460a2bd08352" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-2edd0016-410f-4a2b-bb5b-460a2bd08352" released by "delete_volume" :: held 1.049s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:43 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD Sep 23 00:28:43 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created reservations ['c98f9f24-1707-4113-a56d-8961cb0f3a96', '5fc136f2-b216-4789-b2bc-de6b56fe6911', '0795b759-e47c-494d-9da8-3ef96384e733', '5bf8c549-6b0d-4fcd-b2b4-7cb99fcbdeee', '9f1a463a-281f-4a3d-98b5-7f0e3eeccc79'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:44 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:44 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 is fetched for user 746817494fc140a2b014abdb95cb6de1. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (80a6045b-aaf0-46a7-a3e5-802e1d22b559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa1571b-7492-419d-b65d-cc0386dddc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa1571b-7492-419d-b65d-cc0386dddc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1838202634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12dea48-f8b6-4b46-adc2-eb59ff870db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:44Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17199d18-592b-4e3c-81b9-dcc7708c5f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17199d18-592b-4e3c-81b9-dcc7708c5f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f871c70-89ad-46bd-a5fb-cca588b72daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f871c70-89ad-46bd-a5fb-cca588b72daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12dea48-f8b6-4b46-adc2-eb59ff870db7', 'volume_name': 'volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bfef5a-7138-43cc-a582-42a8159105e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bfef5a-7138-43cc-a582-42a8159105e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053fb8a7-caa4-4dcb-b4d1-8b67cd3ab117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Volume e12dea48-f8b6-4b46-adc2-eb59ff870db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7', 'volume_size': 1} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1838202634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12dea48-f8b6-4b46-adc2-eb59ff870db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:44Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Creating volume e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:44 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e785955-f36e-4d24-86a7-4fe7cfac09e7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:44 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 1073741824 Sep 23 00:28:44 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.408s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Deleted volume successfully. Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9e4db042-1697-4b8b-8862-750b7da6c0f1 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-2edd0016-410f-4a2b-bb5b-460a2bd08352-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:44 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD Sep 23 00:28:44 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:44 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 1073741824" returned: 0 in 0.578s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:44 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 Sep 23 00:28:44 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-cbd1b576-1cfd-4486-822e-5688d18f0f15-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-cbd1b576-1cfd-4486-822e-5688d18f0f15-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-quobyte-cbd1b576-1cfd-4486-822e-5688d18f0f15" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-cbd1b576-1cfd-4486-822e-5688d18f0f15" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73bc69-17c2-4bfe-ae76-a5e6f8093b74]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 Sep 23 00:28:45 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7" returned: 0 in 0.354s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144139497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec1ce11-6da1-40ea-abfd-f427c644a377,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:42Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Creating volume eec1ce11-6da1-40ea-abfd-f427c644a377 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:45 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053fb8a7-caa4-4dcb-b4d1-8b67cd3ab117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 1073741824 Sep 23 00:28:45 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bd91bd-a803-48ad-b2b8-68585cf847c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Volume volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 (e12dea48-f8b6-4b46-adc2-eb59ff870db7): created successfully Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bd91bd-a803-48ad-b2b8-68585cf847c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (80a6045b-aaf0-46a7-a3e5-802e1d22b559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:45 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-692f0a3a-c424-4d0d-84fa-258734bb052f tempest-VolumesSnapshotTestJSON-480272213 None] Created volume successfully. Sep 23 00:28:45 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15" returned: 0 in 0.530s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15 Sep 23 00:28:45 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 1073741824" returned: 0 in 0.585s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 Sep 23 00:28:45 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cbd1b576-1cfd-4486-822e-5688d18f0f15" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-cbd1b576-1cfd-4486-822e-5688d18f0f15" released by "delete_volume" :: held 0.901s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created reservations ['f8a9b670-3144-48e3-8f14-bd55a2fb17d2', 'be7b10ee-b382-49cb-bc93-814d6ec7c3c6', '0af0657b-e852-47e7-acf0-10093cafab40', '335a4b17-7a6d-40b1-9cc3-83c7f511a87f', '02867490-59f8-40d1-a99b-4c115a0cca1d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:46 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:46 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377" returned: 0 in 0.329s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Attempting download of 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume eec1ce11-6da1-40ea-abfd-f427c644a377. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2196d5bf-e2a3-4934-9d17-a41ebb28eac1]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq Sep 23 00:28:46 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:46 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.348s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Deleted volume successfully. Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Creating offline snapshot e198fa94-760e-4174-9d1a-bda232dfd31c of volume e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-70df3964-f7d5-4762-8100-bcf8729b5a24 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-cbd1b576-1cfd-4486-822e-5688d18f0f15-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2c3ca-8980-490c-980f-d2b08cb0b315]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 Sep 23 00:28:46 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:46 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq Sep 23 00:28:46 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7" returned: 0 in 0.425s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c 1G Sep 23 00:28:47 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq" returned: 1 in 0.449s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_8nxfkegq' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d39ad-e7b7-4229-89c3-59c202a8f5fb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-3a8442ed-b6f5-4b66-a5df-3e8d33860913-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-3a8442ed-b6f5-4b66-a5df-3e8d33860913-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:47 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD Sep 23 00:28:47 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-quobyte-3a8442ed-b6f5-4b66-a5df-3e8d33860913" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-3a8442ed-b6f5-4b66-a5df-3e8d33860913" acquired by "delete_volume" :: waited 0.036s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1308a13c-29b1-409d-990f-000b0777567d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 Sep 23 00:28:47 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c 1G" returned: 0 in 0.600s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] 6eb882ce-4d61-40f4-9438-6ccb8337d906 was qcow2, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:28:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c Sep 23 00:28:47 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 Sep 23 00:28:47 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913" returned: 0 in 0.527s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913 Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c" returned: 0 in 0.375s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c is being set with open permissions: ugo+rw Sep 23 00:28:48 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c Sep 23 00:28:48 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c" returned: 0 in 0.307s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3a8442ed-b6f5-4b66-a5df-3e8d33860913" returned: 0 in 0.362s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-3a8442ed-b6f5-4b66-a5df-3e8d33860913" released by "delete_volume" :: held 0.951s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info Sep 23 00:28:48 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created reservations ['103a23f2-03c1-4494-a7d9-9a5ab15684d0', '809a46e8-80d4-4129-bc19-dae8fe792d02', '7d2b8a81-539e-4fbb-af01-795d7ce98994', 'a7de19ee-ca74-4581-b10f-a385114c3d47', '1d20b192-d801-4291-aeff-4287c83328a2'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:48 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info" returned: 0 in 0.397s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info is being set with open permissions: ugo+rw Sep 23 00:28:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info Sep 23 00:28:48 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:49 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.377s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Deleted volume successfully. Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a6ea7d39-ed9f-42ea-9535-55f80b2b9f3e tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-3a8442ed-b6f5-4b66-a5df-3e8d33860913-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:49 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.info" returned: 0 in 0.393s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-575bc2a0-45a6-4fcd-9033-78c73712c204 tempest-VolumesSnapshotTestJSON-480272213 None] Create snapshot completed successfully Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-e3bda7aa-2ba0-42a9-8157-0add45259e68-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-e3bda7aa-2ba0-42a9-8157-0add45259e68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-quobyte-e3bda7aa-2ba0-42a9-8157-0add45259e68" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-e3bda7aa-2ba0-42a9-8157-0add45259e68" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0603930c-a2de-4ced-81ec-46f181d1dcca]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:50 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 Sep 23 00:28:50 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:50 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377" returned: 0 in 2.585s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_hj6pjk_rdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:50 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Converted 112.00 MB image at 43.27 MB/s Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:50 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 1G Sep 23 00:28:50 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:50 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68" returned: 0 in 0.649s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:50 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68 Sep 23 00:28:50 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:50 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 1G" returned: 0 in 0.486s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Downloaded image 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume eec1ce11-6da1-40ea-abfd-f427c644a377 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 for user 746817494fc140a2b014abdb95cb6de1 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Marking volume eec1ce11-6da1-40ea-abfd-f427c644a377 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Copying metadata from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 to eec1ce11-6da1-40ea-abfd-f427c644a377. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Creating volume glance metadata for volume eec1ce11-6da1-40ea-abfd-f427c644a377 backed by image 6eb882ce-4d61-40f4-9438-6ccb8337d906 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:50 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (513bf06d-c7a1-4930-86f7-f12f4726f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3542432-a9d3-489c-a603-683f2d5a73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e3bda7aa-2ba0-42a9-8157-0add45259e68" returned: 0 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3542432-a9d3-489c-a603-683f2d5a73cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1628833327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d58f47-2dc1-43a8-8b4a-73678e0ad24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e198fa94-760e-4174-9d1a-bda232dfd31c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:51Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3501b1-664d-42bf-954e-d88c2e82b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3501b1-664d-42bf-954e-d88c2e82b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b1b477-7ef3-4786-a9f1-efa53b99dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b1b477-7ef3-4786-a9f1-efa53b99dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38d58f47-2dc1-43a8-8b4a-73678e0ad24f', 'volume_name': 'volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f', 'volume_size': 2, 'snapshot_id': 'e198fa94-760e-4174-9d1a-bda232dfd31c'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4650a6f2-304a-4c20-8169-103d22899f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4650a6f2-304a-4c20-8169-103d22899f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214491db-d668-4e64-afba-a0ecd9d61bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Volume 38d58f47-2dc1-43a8-8b4a-73678e0ad24f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f', 'volume_size': 2, 'snapshot_id': 'e198fa94-760e-4174-9d1a-bda232dfd31c'} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-e3bda7aa-2ba0-42a9-8157-0add45259e68" released by "delete_volume" :: held 1.112s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-e198fa94-760e-4174-9d1a-bda232dfd31c-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e198fa94-760e-4174-9d1a-bda232dfd31c-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Creating volume 38d58f47-2dc1-43a8-8b4a-73678e0ad24f from snapshot e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] snapshot: e198fa94-760e-4174-9d1a-bda232dfd31c, volume: 38d58f47-2dc1-43a8-8b4a-73678e0ad24f, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edef8da-6848-4eff-bba0-4380781f01f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec1ce11-6da1-40ea-abfd-f427c644a377', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6fe241-7bf5-4823-aaac-e13c487c929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created reservations ['dad01439-77ec-428e-b472-574c079a5bd6', '02a8e7fb-bc9e-4a0f-b6dc-071595582806', '03f71833-fa6f-4642-92ec-0adadefc25ad', 'e4e10416-0560-4922-bb9b-7a460ae90cc3', '544f5cb1-0297-466e-8fa3-60ae23a0681a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:51 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Volume volume-eec1ce11-6da1-40ea-abfd-f427c644a377 (eec1ce11-6da1-40ea-abfd-f427c644a377): created successfully Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6fe241-7bf5-4823-aaac-e13c487c929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (f644b02a-4813-4a74-a529-31dd5fecb9fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73dcf0d-a9ad-4c0f-90e7-f84a55e412b3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-214d400d-e107-4ce1-abbe-c253888c62c6 tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:51 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:51 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:51 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c Sep 23 00:28:51 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:51 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.256s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Deleted volume successfully. Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-10ed25fc-ce1f-45e0-adb7-60b61c834d9f tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-e3bda7aa-2ba0-42a9-8157-0add45259e68-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:51 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c" returned: 0 in 0.456s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd48a86-eaa2-44de-bece-0e8016e6d18e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:51 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 Sep 23 00:28:51 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-quobyte-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c833bd-8525-41e7-a592-23d47aa728bc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:52 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7" returned: 0 in 0.455s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:52 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f Sep 23 00:28:52 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:52 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 Sep 23 00:28:52 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:52 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7" returned: 0 in 0.504s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:52 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7 Sep 23 00:28:52 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:53 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7" returned: 0 in 0.484s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7" released by "delete_volume" :: held 1.076s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created reservations ['57cdc191-a01d-4080-b7aa-61ad4dfaced7', '020dc210-8654-443f-ad65-6520dac68640', 'f9bddcdf-6b22-4156-a58a-84a65501a687', '8e0f95bb-6f83-487a-9b1d-a48f9cd9eb95', 'b6e8da90-f106-415c-a93a-97dc85c13f5c'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:53 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:53 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.475s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Deleted volume successfully. Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c37b5d2c-c411-4f9d-a470-cdc20838f754 tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-ff48bc9c-b548-4f1c-b930-1b4a6ce182a7-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-8d30a1ff-dd7d-4857-a60f-be32e5ba7365-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-8d30a1ff-dd7d-4857-a60f-be32e5ba7365-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "cinder-quobyte-8d30a1ff-dd7d-4857-a60f-be32e5ba7365" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-8d30a1ff-dd7d-4857-a60f-be32e5ba7365" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[953caebf-144d-402c-9c04-65d0939c53e7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:54 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 Sep 23 00:28:54 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:55 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:55 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (ae0a79bd-4aab-4aa0-b80d-3b92b75bbfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d58dc3-272f-43b1-8b65-3116dc46f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d58dc3-272f-43b1-8b65-3116dc46f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1492057132',display_name='tempest-VolumesGetTest-Volume-488459201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16bbfc4-b66e-44b8-9f82-9b19167a70e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:55Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2cd7a3-5539-41cd-b29a-53afa24b1a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2cd7a3-5539-41cd-b29a-53afa24b1a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6ecb44-81a6-4418-9c7b-7b252da7262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6ecb44-81a6-4418-9c7b-7b252da7262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16bbfc4-b66e-44b8-9f82-9b19167a70e2', 'volume_name': 'volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc0b543-c1e4-48f0-8c39-548136e630bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc0b543-c1e4-48f0-8c39-548136e630bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2f385e-e1e8-41dd-ba57-1a93b8f299f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:55 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Volume b16bbfc4-b66e-44b8-9f82-9b19167a70e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2', 'volume_size': 1} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:55 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365" returned: 0 in 0.820s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:55 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365 Sep 23 00:28:55 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:55 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.594s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:28:55 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8d30a1ff-dd7d-4857-a60f-be32e5ba7365" returned: 0 in 0.466s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-quobyte-8d30a1ff-dd7d-4857-a60f-be32e5ba7365" released by "delete_volume" :: held 1.447s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Created reservations ['c7579f99-5a7f-4d15-b747-50921cf2a82e', 'd8066e20-90ca-4041-877b-1a77fc8bd925', 'e2c36ab4-b9d0-4b7d-9b57-26534ce06d88', 'c6f11486-a42d-4451-87d9-d130c54c5ab5', '76b16914-a7bd-4476-b0f9-74c4f823a647'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:56 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:28:56 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.526s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Deleted volume successfully. Sep 23 00:28:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-779946b1-54c0-44fa-ab2f-0d58a5bf879c tempest-CreateVolumesFromSourceVolumeTest-2101364830 None] Lock "cinder-8d30a1ff-dd7d-4857-a60f-be32e5ba7365-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:00 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" returned: 0 in 8.463s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7, size 1024.00 MB, duration 8.46 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:00 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Converted 1024.00 MB image at 120.98 MB/s Sep 23 00:29:00 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f is being set with open permissions: ugo+rw Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:00 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f Sep 23 00:29:00 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:00 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" returned: 0 in 0.329s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" released by "_copy_volume_from_snapshot" :: held 9.865s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=223,cinder:SELECT=168,cinder:INSERT=61,cinder:DELETE=18 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e198fa94-760e-4174-9d1a-bda232dfd31c-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" released by "_create_volume_from_snapshot" :: held 9.956s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.998s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.582s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1492057132',display_name='tempest-VolumesGetTest-Volume-488459201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16bbfc4-b66e-44b8-9f82-9b19167a70e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58750df338d548eb8242150f76b0b94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:55Z,use_quota=True,user_id='746817494fc140a2b014abdb95cb6de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Creating volume b16bbfc4-b66e-44b8-9f82-9b19167a70e2 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:00 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:29:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:01 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 1073741824 Sep 23 00:29:01 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214491db-d668-4e64-afba-a0ecd9d61bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f', 'volume_size': 2, 'snapshot_id': 'e198fa94-760e-4174-9d1a-bda232dfd31c'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3529722e-1979-4214-bf47-13a9c62bf496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Volume volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f (38d58f47-2dc1-43a8-8b4a-73678e0ad24f): created successfully Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3529722e-1979-4214-bf47-13a9c62bf496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (513bf06d-c7a1-4930-86f7-f12f4726f43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-36898049-0e0d-45d9-8d8e-c1352a160a72 tempest-VolumesSnapshotTestJSON-480272213 None] Created volume successfully. Sep 23 00:29:01 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 1073741824" returned: 0 in 0.632s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:01 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 Sep 23 00:29:01 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-38d58f47-2dc1-43a8-8b4a-73678e0ad24f-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-38d58f47-2dc1-43a8-8b4a-73678e0ad24f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:01 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2" returned: 0 in 0.329s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2f385e-e1e8-41dd-ba57-1a93b8f299f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9634271a-8d07-4131-ae3d-cdbea001f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Volume volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 (b16bbfc4-b66e-44b8-9f82-9b19167a70e2): created successfully Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9634271a-8d07-4131-ae3d-cdbea001f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Flow 'volume_create_manager' (ae0a79bd-4aab-4aa0-b80d-3b92b75bbfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6101033-02af-45c5-8fb7-1bdd3d1046e1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f92a67fa-aa12-4db1-9f2d-e229b03bd373 tempest-VolumesGetTest-642283079 None] Created volume successfully. Sep 23 00:29:02 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f Sep 23 00:29:02 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:02 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" returned: 0 in 0.461s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:02 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f Sep 23 00:29:02 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-b16bbfc4-b66e-44b8-9f82-9b19167a70e2-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Lock "cinder-b16bbfc4-b66e-44b8-9f82-9b19167a70e2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-b16bbfc4-b66e-44b8-9f82-9b19167a70e2" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-b16bbfc4-b66e-44b8-9f82-9b19167a70e2" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af65966-9455-41a5-a580-969ca28dd8aa]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" returned: 0 in 0.471s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-38d58f47-2dc1-43a8-8b4a-73678e0ad24f" released by "delete_volume" :: held 1.020s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:03 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 Sep 23 00:29:03 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['ad5134ae-a739-44ee-a67d-f2c17f12ec14', '331b134c-e717-4eb4-a05c-e666659b3a13', '0fc35fcc-882d-4643-9959-4bb264c6a9a5', '8b733c9a-12c5-4c40-a379-5b67ac805390', '409deda3-a13b-41a7-a5fe-49ad03e468d0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:03 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Flow 'volume_create_manager' (f30b527b-7ffb-47a9-b552-5171d6a52e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9deebe0-8018-46cd-be63-dff738f52b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9deebe0-8018-46cd-be63-dff738f52b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445354066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac0bde616b46e98165d3ebcc2ae34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:03Z,use_quota=True,user_id='620cca80fb77471da125ee3557dc9fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c51b56-b847-43e4-afef-a25a5ed45118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c51b56-b847-43e4-afef-a25a5ed45118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336f92dd-8e57-450e-ac84-3b1ed652d3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336f92dd-8e57-450e-ac84-3b1ed652d3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45', 'volume_name': 'volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847a7dc2-924f-41ca-8cc1-ad1450952abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847a7dc2-924f-41ca-8cc1-ad1450952abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faffee1-ba69-4250-8a41-48f8fb963a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Volume 1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45', 'volume_size': 1} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445354066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac0bde616b46e98165d3ebcc2ae34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:03Z,use_quota=True,user_id='620cca80fb77471da125ee3557dc9fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Creating volume 1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:03 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2" returned: 0 in 0.602s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 1073741824 Sep 23 00:29:03 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2 Sep 23 00:29:03 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.316s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Deleted volume successfully. Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b566aa5-f3a3-4c79-b308-04ecaa4b0493 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-38d58f47-2dc1-43a8-8b4a-73678e0ad24f-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:03 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b16bbfc4-b66e-44b8-9f82-9b19167a70e2" returned: 0 in 0.317s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-b16bbfc4-b66e-44b8-9f82-9b19167a70e2" released by "delete_volume" :: held 0.976s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:03 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Created reservations ['1b41f3d6-210a-4590-b1d0-2128eba49390', 'fcdee79f-bc29-4abd-bf81-704eed47056e', '825db435-34ce-4e46-8172-d00f1c0524a4', 'e549641f-d874-44c2-84d1-7487ea423626', 'e793bef6-db52-4dcc-80d1-d53dd7297fbc'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:04 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:04 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 1073741824" returned: 0 in 0.591s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 Sep 23 00:29:04 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:04 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-e198fa94-760e-4174-9d1a-bda232dfd31c-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.356s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-e198fa94-760e-4174-9d1a-bda232dfd31c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-e12dea48-f8b6-4b46-adc2-eb59ff870db7" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-cc94d8b0-eb37-457e-8216-a66dc15212e7 tempest-VolumesGetTest-642283079 None] Lock "cinder-b16bbfc4-b66e-44b8-9f82-9b19167a70e2-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e12dea48-f8b6-4b46-adc2-eb59ff870db7" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-e198fa94-760e-4174-9d1a-bda232dfd31c" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e198fa94-760e-4174-9d1a-bda232dfd31c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Deleting offline snapshot e198fa94-760e-4174-9d1a-bda232dfd31c of volume e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:04 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] snapshot_file for this snap is: volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45" returned: 0 in 0.363s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc827cf-7be8-41b4-afc3-e1e280a475d4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faffee1-ba69-4250-8a41-48f8fb963a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29478abc-1b2b-4e20-a3c1-44a8acadc68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Volume volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 (1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45): created successfully Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29478abc-1b2b-4e20-a3c1-44a8acadc68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Flow 'volume_create_manager' (f30b527b-7ffb-47a9-b552-5171d6a52e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7724adb9-4235-4b26-8a15-80db1e3891f2 tempest-ProjectReaderTests-209147701 None] Created volume successfully. Sep 23 00:29:04 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c Sep 23 00:29:04 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:04 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c" returned: 0 in 0.445s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[040ebaf6-85de-4d5e-90ef-f0f71e6caabc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-eec1ce11-6da1-40ea-abfd-f427c644a377-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:05 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 Sep 23 00:29:05 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Lock "cinder-eec1ce11-6da1-40ea-abfd-f427c644a377-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Acquiring lock "cinder-quobyte-eec1ce11-6da1-40ea-abfd-f427c644a377" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-eec1ce11-6da1-40ea-abfd-f427c644a377" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a55b2a-81e0-4452-92ed-636dde63a12d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:05 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 Sep 23 00:29:05 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Acquiring lock "cinder-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Lock "cinder-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Acquiring lock "cinder-quobyte-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Lock "cinder-quobyte-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3d60e-e007-42b8-8beb-a105fe8b29d3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:05 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7" returned: 0 in 0.762s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:05 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c Sep 23 00:29:05 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:05 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377" returned: 0 in 0.546s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:05 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377 Sep 23 00:29:05 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:05 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 Sep 23 00:29:05 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-eec1ce11-6da1-40ea-abfd-f427c644a377" returned: 0 in 0.365s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45" returned: 0 in 0.482s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:06 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Lock "cinder-quobyte-eec1ce11-6da1-40ea-abfd-f427c644a377" released by "delete_volume" :: held 0.986s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c" returned: 0 in 0.451s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:06 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45 Sep 23 00:29:06 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c Sep 23 00:29:06 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Created reservations ['bdae0492-653c-492d-8226-95de9a68fda7', '279509f3-cd17-4b27-a8b8-6b0933c856dc', '3ce91c39-2857-4a42-8fd2-369d23ec8f14', '512a8724-a04a-415d-a116-d6d749507432', 'aa622d23-2b5f-45f0-ba62-41d6b9e869ad'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:06 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:06 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45" returned: 0 in 0.344s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Lock "cinder-quobyte-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45" released by "delete_volume" :: held 0.896s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:06 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7.e198fa94-760e-4174-9d1a-bda232dfd31c" returned: 0 in 0.362s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e198fa94-760e-4174-9d1a-bda232dfd31c" released by "_delete_snapshot" :: held 2.163s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e12dea48-f8b6-4b46-adc2-eb59ff870db7" released by "delete_snapshot" :: held 2.200s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Created reservations ['ac2d0e9e-eab1-465a-950b-e599664e3d1d', '7abc3b59-ce71-451d-a0f3-8779ea212b24', 'baef7948-a8d1-42ac-9a34-f2b269e5616e', 'e970a4e4-4a18-4e6f-b3d5-c3c2f853b549', '9a5d9da2-59e4-4594-a80b-845fd8551758'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:06 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.310s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_db.api [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 00:29:06 devstack cinder-volume[87292]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 00:29:06 devstack cinder-volume[87292]: FROM reservations Sep 23 00:29:06 devstack cinder-volume[87292]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s, %(uuid_1_5)s) FOR UPDATE] Sep 23 00:29:06 devstack cinder-volume[87292]: [parameters: {'uuid_1_1': 'ac2d0e9e-eab1-465a-950b-e599664e3d1d', 'uuid_1_2': '7abc3b59-ce71-451d-a0f3-8779ea212b24', 'uuid_1_3': 'baef7948-a8d1-42ac-9a34-f2b269e5616e', 'uuid_1_4': 'e970a4e4-4a18-4e6f-b3d5-c3c2f853b549', 'uuid_1_5': '9a5d9da2-59e4-4594-a80b-845fd8551758'}] Sep 23 00:29:06 devstack cinder-volume[87292]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87292) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG oslo_db.api [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87292) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['bae2fdfd-14f6-4212-91c0-16011e210ad2', '5bc4203c-0760-440d-afce-5ab7953d2b7b', 'c0eb6111-bcb1-4cfa-a0be-757d56ec2774', 'eff5d68c-3130-4c5e-b6a6-bd35452ae4f6', 'db0ce18a-5e73-414c-b1a4-bf100cbe2af2'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Deleted volume successfully. Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a874dab5-0419-4c0f-881e-f7dfea236aca tempest-VolumesGetTest-642283079 None] Lock "cinder-eec1ce11-6da1-40ea-abfd-f427c644a377-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Delete snapshot completed successfully. Sep 23 00:29:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f053ab67-253e-4443-b533-6a61db13a27d tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-e198fa94-760e-4174-9d1a-bda232dfd31c-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Flow 'volume_create_manager' (0c1e5fb8-c12f-4d90-8b3a-225b8f553ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5609d1f0-e159-45d6-85b3-e720b3f18ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5609d1f0-e159-45d6-85b3-e720b3f18ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207886663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24ca8f7-186d-45aa-9ee6-f55d76cf809e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac0bde616b46e98165d3ebcc2ae34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:07Z,use_quota=True,user_id='620cca80fb77471da125ee3557dc9fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a54f796-8c64-49e9-ace4-a58a3829adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a54f796-8c64-49e9-ace4-a58a3829adf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a28555e-f4fd-4b5c-93e2-997ad8763bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a28555e-f4fd-4b5c-93e2-997ad8763bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24ca8f7-186d-45aa-9ee6-f55d76cf809e', 'volume_name': 'volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3b7daf-e139-4595-9c3c-d732de4ae348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3b7daf-e139-4595-9c3c-d732de4ae348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c5c85a-86d5-4763-ab85-82338aac8453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Volume a24ca8f7-186d-45aa-9ee6-f55d76cf809e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e', 'volume_size': 1} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207886663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24ca8f7-186d-45aa-9ee6-f55d76cf809e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac0bde616b46e98165d3ebcc2ae34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:07Z,use_quota=True,user_id='620cca80fb77471da125ee3557dc9fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Creating volume a24ca8f7-186d-45aa-9ee6-f55d76cf809e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:07 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:07 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e 1073741824 Sep 23 00:29:07 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-e12dea48-f8b6-4b46-adc2-eb59ff870db7-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-e12dea48-f8b6-4b46-adc2-eb59ff870db7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-e12dea48-f8b6-4b46-adc2-eb59ff870db7" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e12dea48-f8b6-4b46-adc2-eb59ff870db7" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4218ec-e15b-4e15-a209-43a57d9818ad]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:07 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:07 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e 1073741824" returned: 0 in 0.583s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 Sep 23 00:29:08 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:08 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e Sep 23 00:29:08 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.339s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Deleted volume successfully. Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-849bfae4-1b32-49f3-a084-108d7da5addd tempest-ProjectReaderTests-209147701 None] Lock "cinder-1fc33e97-cd7b-42ef-9dd2-91e89ffa9c45-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:08 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c5c85a-86d5-4763-ab85-82338aac8453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:08 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb92b327-f254-4dcf-a6bd-81bac705b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7" returned: 0 in 0.549s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:08 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Volume volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e (a24ca8f7-186d-45aa-9ee6-f55d76cf809e): created successfully Sep 23 00:29:08 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7 Sep 23 00:29:08 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb92b327-f254-4dcf-a6bd-81bac705b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Flow 'volume_create_manager' (0c1e5fb8-c12f-4d90-8b3a-225b8f553ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-294021ef-4ec9-483e-9a32-5e7bbeebda16 tempest-ProjectReaderTests-209147701 None] Created volume successfully. Sep 23 00:29:08 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e12dea48-f8b6-4b46-adc2-eb59ff870db7" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e12dea48-f8b6-4b46-adc2-eb59ff870db7" released by "delete_volume" :: held 0.913s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['e3fe59e6-bbde-4c85-b4a6-0a2f2bdeaab1', '7c32b661-bce9-4adc-a0cf-f9212f302d3e', '82a661d8-42e7-4223-9e79-c36f20641278', '38d415d9-d3a8-4e0e-b712-4c8708d71bf2', '8bc6fd90-f473-4c0f-b82f-b64a1d3acc31'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:08 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:08 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:09 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.303s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Deleted volume successfully. Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-436f8826-7282-4cdf-9017-681cec77807e tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-e12dea48-f8b6-4b46-adc2-eb59ff870db7-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Acquiring lock "cinder-a24ca8f7-186d-45aa-9ee6-f55d76cf809e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Lock "cinder-a24ca8f7-186d-45aa-9ee6-f55d76cf809e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Acquiring lock "cinder-quobyte-a24ca8f7-186d-45aa-9ee6-f55d76cf809e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Lock "cinder-quobyte-a24ca8f7-186d-45aa-9ee6-f55d76cf809e" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0cd3c1-60b3-4e1b-ab52-e6a2d4cdf8c8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:09 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e Sep 23 00:29:09 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:10 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e" returned: 0 in 0.451s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e Sep 23 00:29:10 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:10 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a24ca8f7-186d-45aa-9ee6-f55d76cf809e" returned: 0 in 0.339s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Lock "cinder-quobyte-a24ca8f7-186d-45aa-9ee6-f55d76cf809e" released by "delete_volume" :: held 0.852s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Created reservations ['d4991053-3233-4b98-b418-ff1b9c5b55be', 'd976fa0c-c037-43b7-be5a-f79fe2372f55', '901dad1b-d047-45d9-9976-4b6fbef3ef1c', '2b1c6aaa-386f-40af-8605-3a048c597d21', 'a47b9f5a-8d12-4ded-b22b-97a8e1f032d8'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:10 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (32058c18-7c3c-47f3-a91e-0244fce676d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a2f716-8d1b-4a77-b037-155aead3c2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a2f716-8d1b-4a77-b037-155aead3c2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-863527601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b8365e-3c60-4ad7-9d9f-0631359e95dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:11Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da21de4a-b855-41be-8f61-4e627731e436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da21de4a-b855-41be-8f61-4e627731e436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82d13e5-6a2a-47e2-a867-9c233cc17f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82d13e5-6a2a-47e2-a867-9c233cc17f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b8365e-3c60-4ad7-9d9f-0631359e95dc', 'volume_name': 'volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12672806-ed62-4976-8e30-72253e621023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12672806-ed62-4976-8e30-72253e621023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a48fa8-7862-4cd5-822a-13bb35b9c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Volume c1b8365e-3c60-4ad7-9d9f-0631359e95dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc', 'volume_size': 1} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-863527601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b8365e-3c60-4ad7-9d9f-0631359e95dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:11Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Creating volume c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:10 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:29:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc 1073741824 Sep 23 00:29:10 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.368s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Deleted volume successfully. Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-1a56e1ca-6f57-48cf-a5ef-d9336d5c5e5f tempest-ProjectReaderTests-209147701 None] Lock "cinder-a24ca8f7-186d-45aa-9ee6-f55d76cf809e-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:11 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc 1073741824" returned: 0 in 0.601s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc Sep 23 00:29:11 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" returned: 0 in 0.288s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a48fa8-7862-4cd5-822a-13bb35b9c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1de1a05-c6ab-4df8-a004-edd5a7cb4c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:11 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Volume volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc (c1b8365e-3c60-4ad7-9d9f-0631359e95dc): created successfully Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1de1a05-c6ab-4df8-a004-edd5a7cb4c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (32058c18-7c3c-47f3-a91e-0244fce676d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cb5efc5a-0943-4a20-baa9-1cd2bdb9aeeb tempest-VolumesSnapshotTestJSON-480272213 None] Created volume successfully. Sep 23 00:29:12 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Flow 'volume_create_manager' (85465da5-5768-4923-9e9b-8cec7cf62277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8f7bd6-2551-4dad-9801-ab773707de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8f7bd6-2551-4dad-9801-ab773707de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-15957282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76896ca1-c381-4390-acdf-c23c5db86af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0146b230d8114f50ab0ccdbc394a85d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:13Z,use_quota=True,user_id='18e888a0567e4317bde28c6d2fcc4a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b070077-530d-46a7-a501-03bc3157f8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b070077-530d-46a7-a501-03bc3157f8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d338496-5e65-49b7-9afe-83e34044e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d338496-5e65-49b7-9afe-83e34044e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76896ca1-c381-4390-acdf-c23c5db86af6', 'volume_name': 'volume-76896ca1-c381-4390-acdf-c23c5db86af6', 'volume_size': 2}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fa521b-2c00-4216-b8fa-140d34b91bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fa521b-2c00-4216-b8fa-140d34b91bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f18fb5b-3b67-42a6-97d7-751a25b07c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Volume 76896ca1-c381-4390-acdf-c23c5db86af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76896ca1-c381-4390-acdf-c23c5db86af6', 'volume_size': 2} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-15957282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76896ca1-c381-4390-acdf-c23c5db86af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0146b230d8114f50ab0ccdbc394a85d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:13Z,use_quota=True,user_id='18e888a0567e4317bde28c6d2fcc4a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Creating volume 76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:13 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 2147483648 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:13 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 2147483648 Sep 23 00:29:13 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:13 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 2147483648" returned: 0 in 0.600s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:13 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 Sep 23 00:29:13 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:14 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.888s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f18fb5b-3b67-42a6-97d7-751a25b07c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76896ca1-c381-4390-acdf-c23c5db86af6', 'volume_size': 2}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefc96b3-906e-4d91-aa3b-b11560f8e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Creating offline snapshot d470ff5c-e843-425e-a77e-16beec3692de of volume c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:14 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Volume volume-76896ca1-c381-4390-acdf-c23c5db86af6 (76896ca1-c381-4390-acdf-c23c5db86af6): created successfully Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefc96b3-906e-4d91-aa3b-b11560f8e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Flow 'volume_create_manager' (85465da5-5768-4923-9e9b-8cec7cf62277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[881bde47-bc60-4a7f-aef7-e41bc9110417]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3a0a91f8-0bc0-4c2f-95f8-dc1d443aaf0c tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Created volume successfully. Sep 23 00:29:14 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc Sep 23 00:29:14 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:14 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" returned: 0 in 0.396s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:14 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de 1G Sep 23 00:29:14 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:15 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de 1G" returned: 0 in 0.509s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:15 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de Sep 23 00:29:15 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:15 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de" returned: 0 in 0.408s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:15 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de is being set with open permissions: ugo+rw Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:15 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de Sep 23 00:29:15 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:15 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:15 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info Sep 23 00:29:15 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info" returned: 0 in 0.325s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info is being set with open permissions: ugo+rw Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info Sep 23 00:29:16 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.info" returned: 0 in 0.286s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.024s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Creating offline snapshot 7789b663-8af3-4d7f-b852-9440f75262a9 of volume 76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9d583f9f-5c01-4a15-a11d-ecea52e93a03 tempest-VolumesSnapshotTestJSON-480272213 None] Create snapshot completed successfully Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee19f8-bdd2-4d03-9dd0-f4efe62826ef]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 Sep 23 00:29:16 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6" returned: 0 in 0.411s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 2G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 2G Sep 23 00:29:16 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:17 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 2G" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76896ca1-c381-4390-acdf-c23c5db86af6 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:17 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76896ca1-c381-4390-acdf-c23c5db86af6 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 Sep 23 00:29:17 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:17 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76896ca1-c381-4390-acdf-c23c5db86af6 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9" returned: 0 in 0.308s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:17 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 is being set with open permissions: ugo+rw Sep 23 00:29:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:17 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 Sep 23 00:29:17 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:17 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9" returned: 0 in 0.335s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:18 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info Sep 23 00:29:18 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (286c427a-c21c-44aa-a1a7-721b9a231d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5609642e-18c4-4d35-8173-e603acd6d3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5609642e-18c4-4d35-8173-e603acd6d3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-960283811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92cd807-3bc9-4d92-b14a-00734b4f318c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f839cb26f3f24d37aad71de72d1d01e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d470ff5c-e843-425e-a77e-16beec3692de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:18Z,use_quota=True,user_id='e82d0e2b68984b1ead8f4e7a9241e606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a58ed4-9676-48ae-93f9-aecd8a0cab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a58ed4-9676-48ae-93f9-aecd8a0cab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2cb0d0-cccb-41af-beae-7743e5a30eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2cb0d0-cccb-41af-beae-7743e5a30eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e92cd807-3bc9-4d92-b14a-00734b4f318c', 'volume_name': 'volume-e92cd807-3bc9-4d92-b14a-00734b4f318c', 'volume_size': 1, 'snapshot_id': 'd470ff5c-e843-425e-a77e-16beec3692de'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2887da58-f20c-4183-9aa4-b5f5e5956235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2887da58-f20c-4183-9aa4-b5f5e5956235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e9563e-8dd6-4d15-ae37-f9e385a3c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Volume e92cd807-3bc9-4d92-b14a-00734b4f318c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e92cd807-3bc9-4d92-b14a-00734b4f318c', 'volume_size': 1, 'snapshot_id': 'd470ff5c-e843-425e-a77e-16beec3692de'} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:18 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info" returned: 0 in 0.299s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:18 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info is being set with open permissions: ugo+rw Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:18 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info Sep 23 00:29:18 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:18 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.info" returned: 0 in 0.334s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.442s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-d470ff5c-e843-425e-a77e-16beec3692de-e92cd807-3bc9-4d92-b14a-00734b4f318c" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-d470ff5c-e843-425e-a77e-16beec3692de-e92cd807-3bc9-4d92-b14a-00734b4f318c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Creating volume e92cd807-3bc9-4d92-b14a-00734b4f318c from snapshot d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-e92cd807-3bc9-4d92-b14a-00734b4f318c" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e92cd807-3bc9-4d92-b14a-00734b4f318c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] snapshot: d470ff5c-e843-425e-a77e-16beec3692de, volume: e92cd807-3bc9-4d92-b14a-00734b4f318c, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f716d6-b587-49c9-98a9-bc5651b5f96d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5d479862-411d-45f3-80b9-1e9154dfae66 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Create snapshot completed successfully Sep 23 00:29:18 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de Sep 23 00:29:18 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de" returned: 0 in 0.436s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47efeff-2322-460a-b17e-1de112adb4fc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc Sep 23 00:29:19 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" returned: 0 in 0.374s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c Sep 23 00:29:19 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "cinder-7789b663-8af3-4d7f-b852-9440f75262a9-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-7789b663-8af3-4d7f-b852-9440f75262a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "cinder-quobyte-76896ca1-c381-4390-acdf-c23c5db86af6" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-quobyte-76896ca1-c381-4390-acdf-c23c5db86af6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "cinder-quobyte-7789b663-8af3-4d7f-b852-9440f75262a9" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-quobyte-7789b663-8af3-4d7f-b852-9440f75262a9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Deleting offline snapshot 7789b663-8af3-4d7f-b852-9440f75262a9 of volume 76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] snapshot_file for this snap is: volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df57bbd3-f7d0-4b59-9a3c-d91c4e775263]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 Sep 23 00:29:19 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9" returned: 0 in 0.570s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76896ca1-c381-4390-acdf-c23c5db86af6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f0dadc-d027-48f1-8157-1cf248c57248]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:20 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 Sep 23 00:29:20 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6" returned: 0 in 0.541s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:21 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 Sep 23 00:29:21 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:21 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9" returned: 0 in 0.580s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:21 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9 Sep 23 00:29:21 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:21 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6.7789b663-8af3-4d7f-b852-9440f75262a9" returned: 0 in 0.375s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-quobyte-7789b663-8af3-4d7f-b852-9440f75262a9" released by "_delete_snapshot" :: held 2.264s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-quobyte-76896ca1-c381-4390-acdf-c23c5db86af6" released by "delete_snapshot" :: held 2.295s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:22 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Created reservations ['ac0acfa1-e7d4-4a3d-a325-a6c53dcb1ea9', '1df2b7eb-645e-49da-8e53-cdce1eb8680d', 'e8a553a5-2fcb-4db0-ae01-e528b814438d', '7ec3c0f3-e267-47e8-bf2e-ee75447f5112', '1e5429e9-26ad-48d2-8dae-03b36f56f838'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:22 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Delete snapshot completed successfully. Sep 23 00:29:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-039d06ac-ae2a-4bbe-a4b5-8a762092f204 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-7789b663-8af3-4d7f-b852-9440f75262a9-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "cinder-76896ca1-c381-4390-acdf-c23c5db86af6-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-76896ca1-c381-4390-acdf-c23c5db86af6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "cinder-quobyte-76896ca1-c381-4390-acdf-c23c5db86af6" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-quobyte-76896ca1-c381-4390-acdf-c23c5db86af6" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff105869-bf0e-4045-97fd-f5dee3197bf0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 Sep 23 00:29:23 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:23 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6" returned: 0 in 0.597s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6 Sep 23 00:29:24 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-76896ca1-c381-4390-acdf-c23c5db86af6" returned: 0 in 0.584s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-quobyte-76896ca1-c381-4390-acdf-c23c5db86af6" released by "delete_volume" :: held 1.322s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Created reservations ['496cfd71-35e2-418c-ad74-a127f9e480bf', 'd3d275eb-6cba-4396-8b88-08cc9e43b7a3', '3b7b442d-1cd2-427a-95a8-117147e893f1', '1c077380-2958-48f2-9ad2-fe165fda44ba', 'af2d5fd9-ddf0-4780-aad6-7190535c500f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:24 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.397s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Deleted volume successfully. Sep 23 00:29:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8a503044-ff68-429e-9532-2d5d58614237 tempest-VolumesSnapshotNegativeTestJSON-963451884 None] Lock "cinder-76896ca1-c381-4390-acdf-c23c5db86af6-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:26 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c" returned: 0 in 6.992s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:26 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Converted 1024.00 MB image at 146.43 MB/s Sep 23 00:29:26 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c is being set with open permissions: ugo+rw Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c Sep 23 00:29:26 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:26 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c" returned: 0 in 0.261s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e92cd807-3bc9-4d92-b14a-00734b4f318c" released by "_copy_volume_from_snapshot" :: held 8.150s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-d470ff5c-e843-425e-a77e-16beec3692de-e92cd807-3bc9-4d92-b14a-00734b4f318c" released by "_create_volume_from_snapshot" :: held 8.213s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.245s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e9563e-8dd6-4d15-ae37-f9e385a3c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92cd807-3bc9-4d92-b14a-00734b4f318c', 'volume_size': 1, 'snapshot_id': 'd470ff5c-e843-425e-a77e-16beec3692de'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca73ac3-2b93-4852-b5ee-4e6ec6cc1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Volume volume-e92cd807-3bc9-4d92-b14a-00734b4f318c (e92cd807-3bc9-4d92-b14a-00734b4f318c): created successfully Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca73ac3-2b93-4852-b5ee-4e6ec6cc1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Flow 'volume_create_manager' (286c427a-c21c-44aa-a1a7-721b9a231d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:26 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7c08abd5-d013-4007-a0a3-32e7ddd47d67 tempest-VolumesSnapshotTestJSON-480272213 None] Created volume successfully. Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-e92cd807-3bc9-4d92-b14a-00734b4f318c-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-e92cd807-3bc9-4d92-b14a-00734b4f318c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-e92cd807-3bc9-4d92-b14a-00734b4f318c" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e92cd807-3bc9-4d92-b14a-00734b4f318c" acquired by "delete_volume" :: waited 0.014s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bcc365-c43b-4f3e-a1fc-e2f7557f3c2d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c Sep 23 00:29:28 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c" returned: 0 in 0.412s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c Sep 23 00:29:28 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e92cd807-3bc9-4d92-b14a-00734b4f318c" returned: 0 in 0.317s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-e92cd807-3bc9-4d92-b14a-00734b4f318c" released by "delete_volume" :: held 0.785s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=191,cinder:UPDATE=219,cinder:DELETE=21,cinder:INSERT=70 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:28 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['246810f2-46a0-4e4f-8fae-47e41818fbfd', 'ed562f33-4074-43cc-88df-6f2659e5eff4', 'ec188ce3-7272-44e5-8915-a0127c54bf25', 'd6d124ab-6c0f-4138-951a-f998ddf3b163', '09b707c6-68c5-402f-9960-32d3331713fd'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:29 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:29 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-d470ff5c-e843-425e-a77e-16beec3692de-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-d470ff5c-e843-425e-a77e-16beec3692de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-d470ff5c-e843-425e-a77e-16beec3692de" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-d470ff5c-e843-425e-a77e-16beec3692de" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Deleting offline snapshot d470ff5c-e843-425e-a77e-16beec3692de of volume c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] snapshot_file for this snap is: volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1400036-f404-4c06-8cb7-485ceca80cfe]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:29 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.410s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:29 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Deleted volume successfully. Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0646fcfa-b16f-4b5c-94e2-2b8c1745fc64 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-e92cd807-3bc9-4d92-b14a-00734b4f318c-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:29 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de Sep 23 00:29:29 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de" returned: 0 in 0.482s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4ec5bd-acf1-49a8-a27d-fa8e975ff60a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:30 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc Sep 23 00:29:30 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:30 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" returned: 0 in 0.691s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:30 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de Sep 23 00:29:30 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:31 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de" returned: 0 in 0.366s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:31 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de Sep 23 00:29:31 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:31 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc.d470ff5c-e843-425e-a77e-16beec3692de" returned: 0 in 0.295s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-d470ff5c-e843-425e-a77e-16beec3692de" released by "_delete_snapshot" :: held 1.967s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" released by "delete_snapshot" :: held 1.999s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['7f050dd2-a7ba-4231-a3bc-17637d78e527', '322a1ef0-7172-4cc1-922a-562414b9b338', '5b19762a-9110-4f5f-be7d-daa32119d24d', '3e31940b-2b4d-4cbe-917b-cba4d4d80626', '13372dc3-7c95-4f00-a6f9-c5ff2c54ee06'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Delete snapshot completed successfully. Sep 23 00:29:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-003e91b2-7716-4217-806e-e1c8c0744553 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-d470ff5c-e843-425e-a77e-16beec3692de-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-c1b8365e-3c60-4ad7-9d9f-0631359e95dc-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-c1b8365e-3c60-4ad7-9d9f-0631359e95dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f595ebe3-93f9-401f-a611-951355d977f7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:32 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc Sep 23 00:29:32 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:33 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" returned: 0 in 0.456s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:33 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc Sep 23 00:29:33 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:33 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-c1b8365e-3c60-4ad7-9d9f-0631359e95dc" released by "delete_volume" :: held 0.827s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['b93eb6a4-9052-4683-bf94-c6f4674bfc75', '9fe4b01a-b9f1-4667-9646-fa9737cd2981', 'be9ada56-52f4-45c4-a355-24824d7852f2', '67de66d4-dfe0-4037-9620-616c193e3f13', '8c09ecb1-280d-428f-867a-e2f571f41fc4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:33 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:33 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-1486e941-0215-43a0-b993-cce4a77465fa-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-1486e941-0215-43a0-b993-cce4a77465fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "cinder-quobyte-1486e941-0215-43a0-b993-cce4a77465fa" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-1486e941-0215-43a0-b993-cce4a77465fa" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:34 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.382s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Deleted volume successfully. Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dff70b-5fe7-48c8-af81-0cdee167335f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37a6e227-982d-439c-bdc4-557759a6c3aa tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-c1b8365e-3c60-4ad7-9d9f-0631359e95dc-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:34 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa Sep 23 00:29:34 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa" returned: 0 in 0.476s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa Sep 23 00:29:34 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-1486e941-0215-43a0-b993-cce4a77465fa" returned: 0 in 0.401s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-quobyte-1486e941-0215-43a0-b993-cce4a77465fa" released by "delete_volume" :: held 0.993s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Created reservations ['343e0250-944c-4774-a54c-510fd139c770', '1f61d975-bf46-4d4a-902d-42cb5668a276', 'dbdf1143-c118-4be9-a08b-9470c8ee93fe', '26a7e123-ae23-40ab-89ab-8ca4a26ac9ac', '7117fece-b9b9-4171-bca5-2f0c6eb73504'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:35 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.335s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Deleted volume successfully. Sep 23 00:29:35 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea462839-e42a-45b2-ad6b-dc8beca395f0 tempest-VolumesSnapshotTestJSON-480272213 None] Lock "cinder-1486e941-0215-43a0-b993-cce4a77465fa-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:45 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=140,cinder:SELECT=108,cinder:DELETE=9,cinder:INSERT=33 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:45 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:INSERT=9,cinder:UPDATE=29,cinder:SELECT=17,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Flow 'volume_create_manager' (3809c6ad-f6c6-42d6-a407-f2fb8d2be177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba396e8-c31b-431a-8dee-b01104410d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba396e8-c31b-431a-8dee-b01104410d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1310300683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4189b50a-7ead-4ae2-9619-344282138cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f3e42946364fa69ed12d1788aa6454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:46Z,use_quota=True,user_id='e5c0e0a7d055428d8b83542324b632eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34dd22ea-965d-498d-9957-79a0eb5c66d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34dd22ea-965d-498d-9957-79a0eb5c66d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b93e36-9fa6-4593-a70d-b5adef0bfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b93e36-9fa6-4593-a70d-b5adef0bfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4189b50a-7ead-4ae2-9619-344282138cf3', 'volume_name': 'volume-4189b50a-7ead-4ae2-9619-344282138cf3', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0925d28b-43ab-44cd-aca1-e9bc8b0a3871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0925d28b-43ab-44cd-aca1-e9bc8b0a3871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc3cbe-b494-4fd3-92bc-688247d87265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Volume 4189b50a-7ead-4ae2-9619-344282138cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4189b50a-7ead-4ae2-9619-344282138cf3', 'volume_size': 1} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1310300683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4189b50a-7ead-4ae2-9619-344282138cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f3e42946364fa69ed12d1788aa6454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:46Z,use_quota=True,user_id='e5c0e0a7d055428d8b83542324b632eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Creating volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:46 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:29:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:46 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 1073741824 Sep 23 00:29:46 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 1073741824" returned: 0 in 0.676s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 Sep 23 00:29:47 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3" returned: 0 in 0.462s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc3cbe-b494-4fd3-92bc-688247d87265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4189b50a-7ead-4ae2-9619-344282138cf3', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34006060-3977-44a3-93a6-63f66fe88c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:47 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Volume volume-4189b50a-7ead-4ae2-9619-344282138cf3 (4189b50a-7ead-4ae2-9619-344282138cf3): created successfully Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34006060-3977-44a3-93a6-63f66fe88c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Flow 'volume_create_manager' (3809c6ad-f6c6-42d6-a407-f2fb8d2be177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9820c607-4734-4e76-bea6-d4f865ed5e08 tempest-VolumesSnapshotListTestJSON-992155929 None] Created volume successfully. Sep 23 00:29:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Creating offline snapshot d3d67ddb-6746-4d23-be44-1796d3b3788e of volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dd816f-4cd2-4f4b-886b-85950f291593]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 Sep 23 00:29:49 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:49 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3" returned: 0 in 0.490s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e 1G Sep 23 00:29:49 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e 1G" returned: 0 in 0.630s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:29:50 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e is being set with open permissions: ugo+rw Sep 23 00:29:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:29:50 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.333s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info Sep 23 00:29:50 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info" returned: 0 in 0.314s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info is being set with open permissions: ugo+rw Sep 23 00:29:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:51 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info Sep 23 00:29:51 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.info" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e6829904-73a1-4bc5-b12d-142616317475 tempest-VolumesSnapshotListTestJSON-992155929 None] Create snapshot completed successfully Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Creating offline snapshot c4659dca-1cd3-4dc8-a935-a481916aa535 of volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[700863d0-167d-4f33-aabb-172fe942d5c7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:52 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:29:52 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:52 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.446s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 1G Sep 23 00:29:53 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 1G" returned: 0 in 0.656s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:29:53 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.383s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 is being set with open permissions: ugo+rw Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:29:54 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.283s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b277770b-2e94-49ae-9211-f33f087a796c tempest-VolumesSnapshotListTestJSON-992155929 None] Create snapshot completed successfully Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Creating offline snapshot 42d8629b-99ea-4b12-8c0d-41fba2ac154d of volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0244b53f-7264-429d-af40-c2524a832f24]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:29:55 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:29:55 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.343s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:29:55 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.451s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d 1G Sep 23 00:29:55 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d 1G" returned: 0 in 0.614s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:56 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d Sep 23 00:29:56 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d" returned: 0 in 0.350s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:56 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d is being set with open permissions: ugo+rw Sep 23 00:29:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:56 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d Sep 23 00:29:56 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ff6997b9-9fde-447c-a34d-d2330466cff6 tempest-VolumesSnapshotListTestJSON-992155929 None] Create snapshot completed successfully Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-42d8629b-99ea-4b12-8c0d-41fba2ac154d-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-42d8629b-99ea-4b12-8c0d-41fba2ac154d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-42d8629b-99ea-4b12-8c0d-41fba2ac154d" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-42d8629b-99ea-4b12-8c0d-41fba2ac154d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Deleting offline snapshot 42d8629b-99ea-4b12-8c0d-41fba2ac154d of volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] snapshot_file for this snap is: volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f478bf-27dd-4be0-8ad6-d7c5e9ea27e6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:58 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d Sep 23 00:29:58 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:58 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d" returned: 0 in 0.487s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[782eb12b-7555-46b4-8307-739c5a2f8b8e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:29:59 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.440s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d Sep 23 00:29:59 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d" returned: 0 in 0.474s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d Sep 23 00:29:59 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:00 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.42d8629b-99ea-4b12-8c0d-41fba2ac154d" returned: 0 in 0.302s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-42d8629b-99ea-4b12-8c0d-41fba2ac154d" released by "_delete_snapshot" :: held 1.824s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" released by "delete_snapshot" :: held 1.852s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Created reservations ['af93f8b6-337c-4481-89e7-f49ee409516a', 'dba19f96-f990-4d33-8a5d-1d2b6a4da384', '7e67869e-0f4a-41c0-b9a0-192090c7f5ad', 'fa1b62ea-c839-4f9c-a623-f1b820fb0ec4', '20a8239f-3566-4f9a-afd0-a11173075c4d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Delete snapshot completed successfully. Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-345db140-c999-4d64-af76-fd456e155b47 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-42d8629b-99ea-4b12-8c0d-41fba2ac154d-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-c4659dca-1cd3-4dc8-a935-a481916aa535-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-c4659dca-1cd3-4dc8-a935-a481916aa535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-c4659dca-1cd3-4dc8-a935-a481916aa535" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-c4659dca-1cd3-4dc8-a935-a481916aa535" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Deleting offline snapshot c4659dca-1cd3-4dc8-a935-a481916aa535 of volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] snapshot_file for this snap is: volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[244e35b9-11b3-4e04-b09f-d99c32e98b77]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:30:00 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.450s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d0e04-de24-4779-8939-8f93e6eb85b5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:30:01 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.461s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:30:01 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:02 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.530s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:02 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535 Sep 23 00:30:02 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:02 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.c4659dca-1cd3-4dc8-a935-a481916aa535" returned: 0 in 0.309s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-c4659dca-1cd3-4dc8-a935-a481916aa535" released by "_delete_snapshot" :: held 1.883s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" released by "delete_snapshot" :: held 1.912s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Created reservations ['8b757523-885f-464c-809b-44fdacbeb55e', '89d7ee22-69a8-4e1a-a4b3-b5352286dc07', 'e3a4b332-eecb-4ce4-a068-8d1889545b38', '4480cd6c-37f2-4d1f-b810-bbc42fe3513f', 'cf16800d-2f10-4f18-bcbf-f1e9a0b55405'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Delete snapshot completed successfully. Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ea561048-fa51-41aa-89a2-63beb2760f6e tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-c4659dca-1cd3-4dc8-a935-a481916aa535-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-d3d67ddb-6746-4d23-be44-1796d3b3788e-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-d3d67ddb-6746-4d23-be44-1796d3b3788e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-d3d67ddb-6746-4d23-be44-1796d3b3788e" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-d3d67ddb-6746-4d23-be44-1796d3b3788e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Deleting offline snapshot d3d67ddb-6746-4d23-be44-1796d3b3788e of volume 4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] snapshot_file for this snap is: volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0a640-9139-4b90-9933-32530464a129]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:03 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:30:03 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:03 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.506s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189b50a-7ead-4ae2-9619-344282138cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:03 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43acfdc-112a-4409-9258-a0c7e3ad2306]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:03 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 Sep 23 00:30:03 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:03 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3" returned: 0 in 0.489s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:03 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:30:03 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.431s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:04 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e Sep 23 00:30:04 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3.d3d67ddb-6746-4d23-be44-1796d3b3788e" returned: 0 in 0.343s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-d3d67ddb-6746-4d23-be44-1796d3b3788e" released by "_delete_snapshot" :: held 1.924s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" released by "delete_snapshot" :: held 1.947s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Created reservations ['9b9067a4-4e53-4767-a0a2-765f02920767', '29784a6f-5152-415a-a83d-422767be33d9', '8b3f13a3-0c31-4091-aa6c-482dd3012b66', '526e8c50-4735-48a2-a4f3-9a969816db08', '603b78f1-9a36-4234-acc3-a71da434cbfe'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Delete snapshot completed successfully. Sep 23 00:30:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2ce8229d-e85d-4a62-92e2-9901992e8898 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-d3d67ddb-6746-4d23-be44-1796d3b3788e-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-4189b50a-7ead-4ae2-9619-344282138cf3-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-4189b50a-7ead-4ae2-9619-344282138cf3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b986a67b-a586-4b30-bc6c-b6592617ecc9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:06 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 Sep 23 00:30:06 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:06 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3" returned: 0 in 0.543s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:06 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3 Sep 23 00:30:06 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:07 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4189b50a-7ead-4ae2-9619-344282138cf3" returned: 0 in 0.287s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-quobyte-4189b50a-7ead-4ae2-9619-344282138cf3" released by "delete_volume" :: held 0.949s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Created reservations ['f87e3166-8ad6-4632-a653-ea2fb2165898', 'e9188580-dd2c-4303-8e5f-7809898b9da0', '0d288340-85fe-4ec9-97db-da347b63d5b5', '3fd3a919-4d54-4f31-9f01-d81d47c03da9', '9864a382-d794-45ff-bb33-7740eb368161'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:07 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:30:07 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:07 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Deleted volume successfully. Sep 23 00:30:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c79151dd-cb08-45e9-8cbf-6dbba4887b65 tempest-VolumesSnapshotListTestJSON-992155929 None] Lock "cinder-4189b50a-7ead-4ae2-9619-344282138cf3-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Flow 'volume_create_manager' (c954e473-7481-43cf-9eed-d6bc3aab7c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f85408b-35ec-4b8f-8e6c-ff5e9cfac702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f85408b-35ec-4b8f-8e6c-ff5e9cfac702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-953480832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bfe66f-ad56-4bcc-863b-8ae335e208ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d981a9e2f94e34b88bfebf167eb53c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:12Z,use_quota=True,user_id='57d47883971e483a84d2c2c35b4a03b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59257e41-d33b-433f-a243-be474f79eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59257e41-d33b-433f-a243-be474f79eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7510d1b-0151-48c6-8950-082364810b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7510d1b-0151-48c6-8950-082364810b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9bfe66f-ad56-4bcc-863b-8ae335e208ea', 'volume_name': 'volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9b994-272d-4e4c-b6aa-7fd2809469f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9b994-272d-4e4c-b6aa-7fd2809469f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb1113d-38cb-4e49-9583-77f9c5153f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:12 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Volume b9bfe66f-ad56-4bcc-863b-8ae335e208ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea', 'volume_size': 1} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-953480832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bfe66f-ad56-4bcc-863b-8ae335e208ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d981a9e2f94e34b88bfebf167eb53c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:12Z,use_quota=True,user_id='57d47883971e483a84d2c2c35b4a03b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Creating volume b9bfe66f-ad56-4bcc-863b-8ae335e208ea {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:12 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:30:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:12 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea 1073741824 Sep 23 00:30:12 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:13 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea 1073741824" returned: 0 in 0.767s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:13 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea Sep 23 00:30:13 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:13 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea" returned: 0 in 0.319s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb1113d-38cb-4e49-9583-77f9c5153f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7908a73-0898-42c5-9601-3a731332e2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:13 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Volume volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea (b9bfe66f-ad56-4bcc-863b-8ae335e208ea): created successfully Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7908a73-0898-42c5-9601-3a731332e2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:13 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Flow 'volume_create_manager' (c954e473-7481-43cf-9eed-d6bc3aab7c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fe2b35e3-3d5b-49d3-9262-21e590c4347a tempest-TestMinimumBasicScenario-2065843076 None] Created volume successfully. Sep 23 00:30:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8364082c-0b10-4348-9bb9-3c1ea0a07a7f req-8f30aff7-0ec5-4dec-86f1-a2d3ab34d1c3 tempest-TestMinimumBasicScenario-2065843076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8364082c-0b10-4348-9bb9-3c1ea0a07a7f req-8f30aff7-0ec5-4dec-86f1-a2d3ab34d1c3 tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8364082c-0b10-4348-9bb9-3c1ea0a07a7f req-8f30aff7-0ec5-4dec-86f1-a2d3ab34d1c3 tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-8364082c-0b10-4348-9bb9-3c1ea0a07a7f req-8f30aff7-0ec5-4dec-86f1-a2d3ab34d1c3 tempest-TestMinimumBasicScenario-2065843076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84ca822a-e30c-45c8-af7c-4c7293439422', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:30:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-8364082c-0b10-4348-9bb9-3c1ea0a07a7f req-8f30aff7-0ec5-4dec-86f1-a2d3ab34d1c3 tempest-TestMinimumBasicScenario-2065843076 None] attachment_update completed successfully. Sep 23 00:30:25 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=47,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:25 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=38,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Flow 'volume_create_manager' (7b0c86b3-b85d-4264-abea-3f3d4faebc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdab5ad-9a85-44f4-a9bb-933c90807144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdab5ad-9a85-44f4-a9bb-933c90807144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-902747128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf63a94b930444798bb62042975e8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:39Z,use_quota=True,user_id='5fd07c07bce74a768615ece88a9f31b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2985172b-4718-4cd6-808d-ea047eabd557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2985172b-4718-4cd6-808d-ea047eabd557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e5decd-39f2-4ce1-8160-3272138cec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e5decd-39f2-4ce1-8160-3272138cec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e', 'volume_name': 'volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01dd53f-bad9-4a90-8378-915e5f56bac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01dd53f-bad9-4a90-8378-915e5f56bac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449f91b1-dd5e-4ce4-9fff-b868e3201f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:39 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Volume ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:30:39 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Trying to clone ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:30:40 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27f9fa-a648-4517-9cae-a6206c01836c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD Sep 23 00:30:40 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:40 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 is fetched for user 5fd07c07bce74a768615ece88a9f31b6. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c9be2-62d7-478c-9249-f8dffc5ea90f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD Sep 23 00:30:40 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:41 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-902747128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf63a94b930444798bb62042975e8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:39Z,use_quota=True,user_id='5fd07c07bce74a768615ece88a9f31b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Creating volume ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:41 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:41 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e 1073741824 Sep 23 00:30:41 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:41 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e 1073741824" returned: 0 in 0.630s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:41 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e Sep 23 00:30:41 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" returned: 0 in 0.287s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Attempting download of 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50b2477-6f04-4aa2-a996-06cde751e708]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7 Sep 23 00:30:42 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7" returned: 0 in 0.381s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7 Sep 23 00:30:42 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:43 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7" returned: 1 in 0.430s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6eb882ce-4d61-40f4-9438-6ccb8337d906_oxe52sy7' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f162ef-085d-438a-bf94-ec354dea4d19]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:43 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD Sep 23 00:30:43 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:43 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] 6eb882ce-4d61-40f4-9438-6ccb8337d906 was qcow2, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:30:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:43 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e Sep 23 00:30:43 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" returned: 0 in 2.105s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6eb882ce-4d61-40f4-9438-6ccb8337d906_60xbkuosdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:45 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Converted 112.00 MB image at 53.17 MB/s Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e 1G Sep 23 00:30:45 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e 1G" returned: 0 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Downloaded image 6eb882ce-4d61-40f4-9438-6ccb8337d906 ((None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}])) to volume ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Temporary image 6eb882ce-4d61-40f4-9438-6ccb8337d906 for user 5fd07c07bce74a768615ece88a9f31b6 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Marking volume ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Copying metadata from image 6eb882ce-4d61-40f4-9438-6ccb8337d906 to ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:30:45 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Creating volume glance metadata for volume ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e backed by image 6eb882ce-4d61-40f4-9438-6ccb8337d906 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:30:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449f91b1-dd5e-4ce4-9fff-b868e3201f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e', 'volume_size': 1, 'image_id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6eb882ce-4d61-40f4-9438-6ccb8337d906', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c91fd4d225b43cab53b43085a071845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6eb882ce-4d61-40f4-9438-6ccb8337d906', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6eb882ce-4d61-40f4-9438-6ccb8337d906/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c6793a-c2f0-4787-8654-abe09aa90d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Volume volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e (ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e): created successfully Sep 23 00:30:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c6793a-c2f0-4787-8654-abe09aa90d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Flow 'volume_create_manager' (7b0c86b3-b85d-4264-abea-3f3d4faebc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bdeceb12-30b4-4b24-a628-f911a4ceb234 tempest-TestShelveInstance-796779735 None] Created volume successfully. Sep 23 00:30:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-0e914b5c-0ce9-4257-bcce-972f6b3c5aef req-f792e9f8-19fa-40ef-a6a5-4f1f46aa4c4b tempest-TestShelveInstance-796779735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-0e914b5c-0ce9-4257-bcce-972f6b3c5aef req-f792e9f8-19fa-40ef-a6a5-4f1f46aa4c4b tempest-TestShelveInstance-796779735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-0e914b5c-0ce9-4257-bcce-972f6b3c5aef req-f792e9f8-19fa-40ef-a6a5-4f1f46aa4c4b tempest-TestShelveInstance-796779735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-0e914b5c-0ce9-4257-bcce-972f6b3c5aef req-f792e9f8-19fa-40ef-a6a5-4f1f46aa4c4b tempest-TestShelveInstance-796779735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f56c123e-78ed-40f3-86af-b62568d3016c', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:30:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-0e914b5c-0ce9-4257-bcce-972f6b3c5aef req-f792e9f8-19fa-40ef-a6a5-4f1f46aa4c4b tempest-TestShelveInstance-796779735 None] attachment_update completed successfully. Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:55 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:30:55 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:55 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.401s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:30:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:31:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=5 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=17,cinder:INSERT=9,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-5547b66a-bc7c-47a4-8b30-33e4e5d3ea5b req-69ad3fc4-ae79-4078-8513-c2627ee191d4 tempest-TestMinimumBasicScenario-2065843076 None] Terminate volume connection completed successfully. Sep 23 00:31:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-5547b66a-bc7c-47a4-8b30-33e4e5d3ea5b req-69ad3fc4-ae79-4078-8513-c2627ee191d4 tempest-TestMinimumBasicScenario-2065843076 None] Deleting attachment 84ca822a-e30c-45c8-af7c-4c7293439422. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:31:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Acquiring lock "cinder-b9bfe66f-ad56-4bcc-863b-8ae335e208ea-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Lock "cinder-b9bfe66f-ad56-4bcc-863b-8ae335e208ea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Acquiring lock "cinder-quobyte-b9bfe66f-ad56-4bcc-863b-8ae335e208ea" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Lock "cinder-quobyte-b9bfe66f-ad56-4bcc-863b-8ae335e208ea" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a7906d-1696-4f71-8b0a-db150c219535]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:09 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea Sep 23 00:31:09 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:10 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea" returned: 0 in 0.434s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:10 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea Sep 23 00:31:10 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:10 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b9bfe66f-ad56-4bcc-863b-8ae335e208ea" returned: 0 in 0.326s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Lock "cinder-quobyte-b9bfe66f-ad56-4bcc-863b-8ae335e208ea" released by "delete_volume" :: held 0.836s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Created reservations ['b7c77f00-ea3b-4b54-9af2-d73f741c5b9e', 'ccd66ea9-cec4-4855-b43b-96b5999ac0c7', 'a5cb8103-3e51-40c6-a92b-d2cf6a64f7b1', '61c7f621-4f86-4216-ad3f-148a75436c70', '1bd8463c-fb85-4532-8a1e-8dc6134b2a15'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:10 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:31:10 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:10 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.294s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:10 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Deleted volume successfully. Sep 23 00:31:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2b7e2f5e-efae-476b-b0e9-4d0212d1d728 tempest-TestMinimumBasicScenario-2065843076 None] Lock "cinder-b9bfe66f-ad56-4bcc-863b-8ae335e208ea-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:20 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:21 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-0f1905cc-9587-4dc1-8d2f-addb3a14356f req-749319d2-181a-48b0-ade7-322f13c901e3 tempest-TestShelveInstance-796779735 None] Terminate volume connection completed successfully. Sep 23 00:31:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-0f1905cc-9587-4dc1-8d2f-addb3a14356f req-749319d2-181a-48b0-ade7-322f13c901e3 tempest-TestShelveInstance-796779735 None] Deleting attachment f56c123e-78ed-40f3-86af-b62568d3016c. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:31:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8555669e-77d5-4c99-baf3-4b54e9f12b53 req-f2ec414e-77a2-4ad9-b9ca-e3276cde3694 tempest-TestShelveInstance-796779735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8555669e-77d5-4c99-baf3-4b54e9f12b53 req-f2ec414e-77a2-4ad9-b9ca-e3276cde3694 tempest-TestShelveInstance-796779735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-8555669e-77d5-4c99-baf3-4b54e9f12b53 req-f2ec414e-77a2-4ad9-b9ca-e3276cde3694 tempest-TestShelveInstance-796779735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-8555669e-77d5-4c99-baf3-4b54e9f12b53 req-f2ec414e-77a2-4ad9-b9ca-e3276cde3694 tempest-TestShelveInstance-796779735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1df407b1-3706-41cb-be7b-f798935ea4cb', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-8555669e-77d5-4c99-baf3-4b54e9f12b53 req-f2ec414e-77a2-4ad9-b9ca-e3276cde3694 tempest-TestShelveInstance-796779735 None] attachment_update completed successfully. Sep 23 00:31:51 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:51 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Flow 'volume_create_manager' (ed84e1c5-bf72-4d8f-9264-a8ee2bb0befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0ec914-be83-4b71-86df-1e9605431225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0ec914-be83-4b71-86df-1e9605431225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-61127844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852655c1-c920-477a-92b2-4c1a6f73b58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb126b55b0944a7876ab14edb0df9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:54Z,use_quota=True,user_id='b5c5c5e9847340a69346018a51d49d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d312e54-e561-46f1-bb57-28b0bd2f8cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d312e54-e561-46f1-bb57-28b0bd2f8cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d1b4ec-fa19-4449-807f-063f8ddd05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d1b4ec-fa19-4449-807f-063f8ddd05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852655c1-c920-477a-92b2-4c1a6f73b58c', 'volume_name': 'volume-852655c1-c920-477a-92b2-4c1a6f73b58c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fd4fad-a04c-4822-b7e3-7094cd27d017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fd4fad-a04c-4822-b7e3-7094cd27d017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9953eadb-8f1f-456a-b046-f7a57c6a38d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:53 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Volume 852655c1-c920-477a-92b2-4c1a6f73b58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852655c1-c920-477a-92b2-4c1a6f73b58c', 'volume_size': 1} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-61127844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852655c1-c920-477a-92b2-4c1a6f73b58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb126b55b0944a7876ab14edb0df9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:54Z,use_quota=True,user_id='b5c5c5e9847340a69346018a51d49d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Creating volume 852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:53 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:31:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c 1073741824 Sep 23 00:31:53 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c 1073741824" returned: 0 in 0.600s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c Sep 23 00:31:54 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c" returned: 0 in 0.284s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9953eadb-8f1f-456a-b046-f7a57c6a38d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852655c1-c920-477a-92b2-4c1a6f73b58c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e57e8d9-c446-444f-afc7-d2714f4ed4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Volume volume-852655c1-c920-477a-92b2-4c1a6f73b58c (852655c1-c920-477a-92b2-4c1a6f73b58c): created successfully Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e57e8d9-c446-444f-afc7-d2714f4ed4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Flow 'volume_create_manager' (ed84e1c5-bf72-4d8f-9264-a8ee2bb0befc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f049bf12-3a6d-4776-b7be-19f5803be163 tempest-TestStampPattern-629110055 None] Created volume successfully. Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:31:55 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.345s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:31:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:04 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:04 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-353cbdbf-7530-4bdc-921d-4b17ec562f44 req-f59330d4-abaf-4bb0-ad84-54cd7818b55c tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-353cbdbf-7530-4bdc-921d-4b17ec562f44 req-f59330d4-abaf-4bb0-ad84-54cd7818b55c tempest-TestStampPattern-629110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-353cbdbf-7530-4bdc-921d-4b17ec562f44 req-f59330d4-abaf-4bb0-ad84-54cd7818b55c tempest-TestStampPattern-629110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:27 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-353cbdbf-7530-4bdc-921d-4b17ec562f44 req-f59330d4-abaf-4bb0-ad84-54cd7818b55c tempest-TestStampPattern-629110055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-852655c1-c920-477a-92b2-4c1a6f73b58c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43f68f83-efa9-41ed-9051-e31a84138e47', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:32:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-353cbdbf-7530-4bdc-921d-4b17ec562f44 req-f59330d4-abaf-4bb0-ad84-54cd7818b55c tempest-TestStampPattern-629110055 None] attachment_update completed successfully. Sep 23 00:32:29 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-90f06929-84fb-4a0d-976a-783074669fa4 req-908b02a7-7553-4ace-a5a0-477af095bb2b tempest-TestShelveInstance-796779735 None] Terminate volume connection completed successfully. Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-90f06929-84fb-4a0d-976a-783074669fa4 req-908b02a7-7553-4ace-a5a0-477af095bb2b tempest-TestShelveInstance-796779735 None] Deleting attachment 1df407b1-3706-41cb-be7b-f798935ea4cb. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Acquiring lock "cinder-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Lock "cinder-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Acquiring lock "cinder-quobyte-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Lock "cinder-quobyte-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3b3dcc-9f52-4ae5-8ae0-5e088566d8da]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e Sep 23 00:32:29 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" returned: 0 in 0.522s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e Sep 23 00:32:30 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" returned: 0 in 0.439s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Lock "cinder-quobyte-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e" released by "delete_volume" :: held 1.014s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG cinder.quota [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Created reservations ['cb368355-632b-4ac8-ba5d-59fb2308fdd8', 'fb93abbf-fb1e-4bf3-bc04-63ae9f90eefa', 'c78bc799-0108-4498-bdb6-fec5d97fe6fd', '18458eac-ffc2-4da3-a74d-dbef7040f37a', '745dfd3c-d34d-469b-8a42-2da08c51487f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:32:30 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.266s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:31 devstack cinder-volume[87292]: DEBUG cinder.manager [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Deleted volume successfully. Sep 23 00:32:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [req-90f06929-84fb-4a0d-976a-783074669fa4 req-05145189-257f-4d8a-8f29-48144782273a tempest-TestShelveInstance-796779735 None] Lock "cinder-ebaa9938-fcbe-4d79-a30d-7b8ae3093d3e-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-18ac7689-e8e0-4b54-8ef8-713546ef16a2 req-b13c8b4a-a947-412a-b8af-e2e01cd298f7 tempest-TestStampPattern-629110055 None] Terminate volume connection completed successfully. Sep 23 00:32:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-18ac7689-e8e0-4b54-8ef8-713546ef16a2 req-b13c8b4a-a947-412a-b8af-e2e01cd298f7 tempest-TestStampPattern-629110055 None] Deleting attachment 43f68f83-efa9-41ed-9051-e31a84138e47. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Creating offline snapshot 92e43619-4cb4-4535-afc1-f04413ae40a3 of volume 852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc46c98-a45b-4eff-9bb4-0e43d66bc048]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c Sep 23 00:32:34 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c" returned: 0 in 0.409s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 1G Sep 23 00:32:34 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 1G" returned: 0 in 0.493s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852655c1-c920-477a-92b2-4c1a6f73b58c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852655c1-c920-477a-92b2-4c1a6f73b58c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 Sep 23 00:32:35 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852655c1-c920-477a-92b2-4c1a6f73b58c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3" returned: 0 in 0.313s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 is being set with open permissions: ugo+rw Sep 23 00:32:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 Sep 23 00:32:35 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3" returned: 0 in 0.250s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info Sep 23 00:32:36 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info" returned: 0 in 0.335s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info is being set with open permissions: ugo+rw Sep 23 00:32:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info Sep 23 00:32:36 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.info" returned: 0 in 0.303s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cdda93a0-54cc-42c0-98df-ac9f3c9cdf38 tempest-TestStampPattern-629110055 None] Create snapshot completed successfully Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Flow 'volume_create_manager' (9a377cc3-0470-4916-af4c-1197268a65b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0a816f-6347-4724-9073-489e5756d094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0a816f-6347-4724-9073-489e5756d094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-199474228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b072753e-6462-468f-b1bf-26538935fc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb126b55b0944a7876ab14edb0df9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92e43619-4cb4-4535-afc1-f04413ae40a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:46Z,use_quota=True,user_id='b5c5c5e9847340a69346018a51d49d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8b4fa8-37d8-479b-bd9e-8734b0a439c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8b4fa8-37d8-479b-bd9e-8734b0a439c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9313b2eb-e5ae-4caa-a2b0-c2b72c3118e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9313b2eb-e5ae-4caa-a2b0-c2b72c3118e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b072753e-6462-468f-b1bf-26538935fc66', 'volume_name': 'volume-b072753e-6462-468f-b1bf-26538935fc66', 'volume_size': 1, 'snapshot_id': '92e43619-4cb4-4535-afc1-f04413ae40a3'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d15b15f-2253-479c-9c51-423ba9a7adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d15b15f-2253-479c-9c51-423ba9a7adc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c6ec8b-5851-4d3b-81c9-53497086480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Volume b072753e-6462-468f-b1bf-26538935fc66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b072753e-6462-468f-b1bf-26538935fc66', 'volume_size': 1, 'snapshot_id': '92e43619-4cb4-4535-afc1-f04413ae40a3'} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-quobyte-92e43619-4cb4-4535-afc1-f04413ae40a3-b072753e-6462-468f-b1bf-26538935fc66" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-92e43619-4cb4-4535-afc1-f04413ae40a3-b072753e-6462-468f-b1bf-26538935fc66" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Creating volume b072753e-6462-468f-b1bf-26538935fc66 from snapshot 92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-quobyte-b072753e-6462-468f-b1bf-26538935fc66" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-b072753e-6462-468f-b1bf-26538935fc66" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] snapshot: 92e43619-4cb4-4535-afc1-f04413ae40a3, volume: b072753e-6462-468f-b1bf-26538935fc66, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[499132d9-2d9f-48d2-8c80-0a5b070f0b5c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 Sep 23 00:32:46 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3" returned: 0 in 0.551s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852655c1-c920-477a-92b2-4c1a6f73b58c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[34113417-01a7-4dc5-b7af-3822919c1ee9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c Sep 23 00:32:47 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c" returned: 0 in 0.521s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:32:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 Sep 23 00:32:47 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (71f609e6-0a24-4cb9-aed0-db5ab039f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df198d11-fc2a-4495-963e-8b8de327ec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df198d11-fc2a-4495-963e-8b8de327ec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319676683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03520f27-05ca-4473-bd26-6b82f33d7b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:48Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e665451b-ad54-4255-9e36-ac03e986b6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e665451b-ad54-4255-9e36-ac03e986b6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e81043-e6e4-4d82-b240-1bf603435cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e81043-e6e4-4d82-b240-1bf603435cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03520f27-05ca-4473-bd26-6b82f33d7b36', 'volume_name': 'volume-03520f27-05ca-4473-bd26-6b82f33d7b36', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b891ceb-aff2-413f-9564-5072af8db33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b891ceb-aff2-413f-9564-5072af8db33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c310d50a-0205-4c43-8619-c266c5117aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume 03520f27-05ca-4473-bd26-6b82f33d7b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03520f27-05ca-4473-bd26-6b82f33d7b36', 'volume_size': 1} Sep 23 00:32:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:32:55 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.595s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:32:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66" returned: 0 in 9.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:32:57 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Converted 1024.00 MB image at 109.81 MB/s Sep 23 00:32:57 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 is being set with open permissions: ugo+rw Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 Sep 23 00:32:57 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66" returned: 0 in 0.287s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-b072753e-6462-468f-b1bf-26538935fc66" released by "_copy_volume_from_snapshot" :: held 10.812s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-92e43619-4cb4-4535-afc1-f04413ae40a3-b072753e-6462-468f-b1bf-26538935fc66" released by "_create_volume_from_snapshot" :: held 10.899s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.917s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.668s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319676683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03520f27-05ca-4473-bd26-6b82f33d7b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:48Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating volume 03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:57 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 1073741824 Sep 23 00:32:57 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c6ec8b-5851-4d3b-81c9-53497086480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b072753e-6462-468f-b1bf-26538935fc66', 'volume_size': 1, 'snapshot_id': '92e43619-4cb4-4535-afc1-f04413ae40a3'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73287eaf-4573-42b5-9e72-c55b7b8ce553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Volume volume-b072753e-6462-468f-b1bf-26538935fc66 (b072753e-6462-468f-b1bf-26538935fc66): created successfully Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73287eaf-4573-42b5-9e72-c55b7b8ce553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Flow 'volume_create_manager' (9a377cc3-0470-4916-af4c-1197268a65b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:57 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-76a4e4ad-246c-4e04-8787-f9d1a9363009 tempest-TestStampPattern-629110055 None] Created volume successfully. Sep 23 00:32:58 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 1073741824" returned: 0 in 0.828s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 Sep 23 00:32:58 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36" returned: 0 in 0.379s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c310d50a-0205-4c43-8619-c266c5117aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03520f27-05ca-4473-bd26-6b82f33d7b36', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1840996-7ba6-4aeb-8214-cf3bab26755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume volume-03520f27-05ca-4473-bd26-6b82f33d7b36 (03520f27-05ca-4473-bd26-6b82f33d7b36): created successfully Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1840996-7ba6-4aeb-8214-cf3bab26755c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (71f609e6-0a24-4cb9-aed0-db5ab039f325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a44478c7-c097-4e1a-a771-8c3d5f4902dd tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created volume successfully. Sep 23 00:32:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating offline snapshot 73357673-2fb4-429f-8f5e-a925742a4318 of volume 03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:00 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e107b-47fd-4c07-8ef0-ed0acab01916]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 Sep 23 00:33:00 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36" returned: 0 in 0.466s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 1G Sep 23 00:33:00 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 1G" returned: 0 in 0.563s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03520f27-05ca-4473-bd26-6b82f33d7b36 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03520f27-05ca-4473-bd26-6b82f33d7b36 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 Sep 23 00:33:01 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03520f27-05ca-4473-bd26-6b82f33d7b36 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 is being set with open permissions: ugo+rw Sep 23 00:33:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 Sep 23 00:33:01 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318" returned: 0 in 0.327s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info Sep 23 00:33:01 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info" returned: 0 in 0.342s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info is being set with open permissions: ugo+rw Sep 23 00:33:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info Sep 23 00:33:02 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.info" returned: 0 in 0.309s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-253c6931-87cb-4347-923b-ba3c48802ac2 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Create snapshot completed successfully Sep 23 00:33:03 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (c786d020-f945-4a36-98ae-e971d4e8869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7baa054-8e76-46c8-aac6-52d06cb1d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7baa054-8e76-46c8-aac6-52d06cb1d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887051054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db338da-c76a-483d-82b5-822d0eee15a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:04Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6708c64-8c48-431f-be2c-7f438a3e2e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6708c64-8c48-431f-be2c-7f438a3e2e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edb0e4d-fb56-4d8b-b933-d54769f0a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edb0e4d-fb56-4d8b-b933-d54769f0a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db338da-c76a-483d-82b5-822d0eee15a9', 'volume_name': 'volume-3db338da-c76a-483d-82b5-822d0eee15a9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9545c7-c382-4c3d-8f02-2084a9c88c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9545c7-c382-4c3d-8f02-2084a9c88c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeaaa7e-cee8-4c87-bc52-f615eaadd6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume 3db338da-c76a-483d-82b5-822d0eee15a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db338da-c76a-483d-82b5-822d0eee15a9', 'volume_size': 1} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887051054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db338da-c76a-483d-82b5-822d0eee15a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:04Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating volume 3db338da-c76a-483d-82b5-822d0eee15a9 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:04 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 1073741824 Sep 23 00:33:04 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:04 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (9b8af59e-7d87-44bb-8932-9dbf02fe3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f706b9-633d-4bd4-9bbe-8e0cf91a2975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 1073741824" returned: 0 in 0.714s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f706b9-633d-4bd4-9bbe-8e0cf91a2975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666685885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94cb7c48-aa65-4323-9d27-fafa0f29e6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24df5413-4a8d-4b46-826a-b19f789ee3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24df5413-4a8d-4b46-826a-b19f789ee3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887d22c4-7bac-4de7-bc41-e23d08d35694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887d22c4-7bac-4de7-bc41-e23d08d35694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94cb7c48-aa65-4323-9d27-fafa0f29e6e0', 'volume_name': 'volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f7b6c5-ee92-4953-9d74-96b145d852dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f7b6c5-ee92-4953-9d74-96b145d852dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49abe1b-8607-4363-a2b4-65b83d680214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume 94cb7c48-aa65-4323-9d27-fafa0f29e6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0', 'volume_size': 1} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 Sep 23 00:33:04 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9" returned: 0 in 0.384s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666685885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94cb7c48-aa65-4323-9d27-fafa0f29e6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating volume 94cb7c48-aa65-4323-9d27-fafa0f29e6e0 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:05 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeaaa7e-cee8-4c87-bc52-f615eaadd6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db338da-c76a-483d-82b5-822d0eee15a9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 1073741824 Sep 23 00:33:05 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fcdefe-4e37-4595-8795-515e666d6f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume volume-3db338da-c76a-483d-82b5-822d0eee15a9 (3db338da-c76a-483d-82b5-822d0eee15a9): created successfully Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fcdefe-4e37-4595-8795-515e666d6f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (c786d020-f945-4a36-98ae-e971d4e8869a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (5a084878-8025-4670-bc3e-b691dcb7e9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f6eced-10f1-4d3c-baa4-defc2b7404b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f6eced-10f1-4d3c-baa4-defc2b7404b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606864504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c654e070-66ef-4600-9579-6c8b493312f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f38a299-0dab-4c82-9a64-7ab1767bee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f38a299-0dab-4c82-9a64-7ab1767bee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0901f8fe-5f2e-4296-b46f-40099d192ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0901f8fe-5f2e-4296-b46f-40099d192ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c654e070-66ef-4600-9579-6c8b493312f3', 'volume_name': 'volume-c654e070-66ef-4600-9579-6c8b493312f3', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0676bffd-aecf-4ba4-90f3-5d9198f69213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0676bffd-aecf-4ba4-90f3-5d9198f69213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ceddc44-8ad3-4389-8013-649c64ff1fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume c654e070-66ef-4600-9579-6c8b493312f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c654e070-66ef-4600-9579-6c8b493312f3', 'volume_size': 1} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-38977417-7473-420b-aa15-14a2fc05ac14 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created volume successfully. Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (acd77d96-d5db-4951-ba79-24e80c217729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844beb42-7882-4652-a95c-3a842073bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844beb42-7882-4652-a95c-3a842073bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524862420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414ac8c7-8e30-4002-b521-49707d87b4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d78f4f0-46e7-4e54-9501-8284e0f47169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d78f4f0-46e7-4e54-9501-8284e0f47169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3730c1f6-2521-4ad9-84c4-075cefee4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3730c1f6-2521-4ad9-84c4-075cefee4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414ac8c7-8e30-4002-b521-49707d87b4af', 'volume_name': 'volume-414ac8c7-8e30-4002-b521-49707d87b4af', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bd53be-9059-4453-8cd3-2288fb2d2092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bd53be-9059-4453-8cd3-2288fb2d2092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc0e676-659c-4452-bc0b-a7ff3a1c1208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume 414ac8c7-8e30-4002-b521-49707d87b4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414ac8c7-8e30-4002-b521-49707d87b4af', 'volume_size': 1} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 1073741824" returned: 0 in 0.708s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 Sep 23 00:33:06 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:06 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (1f0bffee-279c-4c50-a7a9-e36118ed34cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6841a9-a55e-42aa-892e-2899479f4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0" returned: 0 in 0.393s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606864504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c654e070-66ef-4600-9579-6c8b493312f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating volume c654e070-66ef-4600-9579-6c8b493312f3 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:06 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6841a9-a55e-42aa-892e-2899479f4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700669745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ac231d-f776-4c78-8244-8df2af4f9677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 1073741824 Sep 23 00:33:06 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401f72db-f8c4-4a2f-aedb-35a24f78441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401f72db-f8c4-4a2f-aedb-35a24f78441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c98b315-3754-4c18-83ee-372d29504149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c98b315-3754-4c18-83ee-372d29504149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ac231d-f776-4c78-8244-8df2af4f9677', 'volume_name': 'volume-a4ac231d-f776-4c78-8244-8df2af4f9677', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c58957-fa8d-425c-87c8-b05d1ee8da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c58957-fa8d-425c-87c8-b05d1ee8da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a69c416-d516-442b-a2ef-e3222f67beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume a4ac231d-f776-4c78-8244-8df2af4f9677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ac231d-f776-4c78-8244-8df2af4f9677', 'volume_size': 1} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49abe1b-8607-4363-a2b4-65b83d680214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc5db3-d55b-4d75-ad2d-6621266fc3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 (94cb7c48-aa65-4323-9d27-fafa0f29e6e0): created successfully Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc5db3-d55b-4d75-ad2d-6621266fc3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (9b8af59e-7d87-44bb-8932-9dbf02fe3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a423487d-f8f9-47e5-94ef-1d90efdfcb92 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created volume successfully. Sep 23 00:33:07 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 1073741824" returned: 0 in 0.551s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 Sep 23 00:33:07 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3" returned: 0 in 0.284s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524862420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414ac8c7-8e30-4002-b521-49707d87b4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating volume 414ac8c7-8e30-4002-b521-49707d87b4af {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:07 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ceddc44-8ad3-4389-8013-649c64ff1fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c654e070-66ef-4600-9579-6c8b493312f3', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af 1073741824 Sep 23 00:33:07 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f948964-f1c7-405f-945a-1b68b104ccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume volume-c654e070-66ef-4600-9579-6c8b493312f3 (c654e070-66ef-4600-9579-6c8b493312f3): created successfully Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f948964-f1c7-405f-945a-1b68b104ccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (5a084878-8025-4670-bc3e-b691dcb7e9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3b6fdb05-f71b-4f21-b63f-4624738d9a55 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created volume successfully. Sep 23 00:33:08 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af 1073741824" returned: 0 in 0.775s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af Sep 23 00:33:08 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af" returned: 0 in 0.311s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700669745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ac231d-f776-4c78-8244-8df2af4f9677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02dedf28dd5495fb30b0f3a9e31e4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='319f3ba4c0944105830bdabb7bb52e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Creating volume a4ac231d-f776-4c78-8244-8df2af4f9677 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:08 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc0e676-659c-4452-bc0b-a7ff3a1c1208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414ac8c7-8e30-4002-b521-49707d87b4af', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 1073741824 Sep 23 00:33:08 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d3cbe0-aa00-4c5d-ad27-75353299448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume volume-414ac8c7-8e30-4002-b521-49707d87b4af (414ac8c7-8e30-4002-b521-49707d87b4af): created successfully Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d3cbe0-aa00-4c5d-ad27-75353299448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (acd77d96-d5db-4951-ba79-24e80c217729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-24e7436d-f81f-4ac2-bebc-28f2a3c73835 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created volume successfully. Sep 23 00:33:09 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 1073741824" returned: 0 in 0.544s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 Sep 23 00:33:09 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677" returned: 0 in 0.268s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a69c416-d516-442b-a2ef-e3222f67beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ac231d-f776-4c78-8244-8df2af4f9677', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb192d3-7da6-48d0-bcef-1253c1b88234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:09 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Volume volume-a4ac231d-f776-4c78-8244-8df2af4f9677 (a4ac231d-f776-4c78-8244-8df2af4f9677): created successfully Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb192d3-7da6-48d0-bcef-1253c1b88234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Flow 'volume_create_manager' (1f0bffee-279c-4c50-a7a9-e36118ed34cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c54d45a6-9310-4ec5-b8b2-e995801c22e5 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created volume successfully. Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-a4ac231d-f776-4c78-8244-8df2af4f9677-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-a4ac231d-f776-4c78-8244-8df2af4f9677-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-a4ac231d-f776-4c78-8244-8df2af4f9677" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-a4ac231d-f776-4c78-8244-8df2af4f9677" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5981837-d12c-452b-a287-80ab88f2d60a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 Sep 23 00:33:10 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677" returned: 0 in 0.401s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677 Sep 23 00:33:10 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a4ac231d-f776-4c78-8244-8df2af4f9677" returned: 0 in 0.303s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-a4ac231d-f776-4c78-8244-8df2af4f9677" released by "delete_volume" :: held 0.772s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['9ee75e8d-07ea-4584-829b-aa6652761cc3', 'e39520dd-1f70-43d9-af03-47d8ad83263c', 'cd06c269-a560-4bda-b304-cd7d1fdf57b6', '2c8d903c-d46b-4242-a239-3a3375bfa5a8', '19b5cfb1-5c67-4baa-8071-38bb5c7778d7'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:11 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-414ac8c7-8e30-4002-b521-49707d87b4af-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-414ac8c7-8e30-4002-b521-49707d87b4af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-414ac8c7-8e30-4002-b521-49707d87b4af" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-414ac8c7-8e30-4002-b521-49707d87b4af" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3474f59a-44e4-4927-9986-b33a0def923a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.346s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleted volume successfully. Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a00473be-031f-4f6d-847f-1db92ca724ed tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-a4ac231d-f776-4c78-8244-8df2af4f9677-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:11 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af Sep 23 00:33:11 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af" returned: 0 in 0.413s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af Sep 23 00:33:11 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-414ac8c7-8e30-4002-b521-49707d87b4af" returned: 0 in 0.348s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-414ac8c7-8e30-4002-b521-49707d87b4af" released by "delete_volume" :: held 0.820s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['51827781-f3ee-4b86-9643-4f51a4f0ea7d', '090ba62e-73ec-42a7-8499-b39b4d2013c9', '074f7481-527f-4380-8e04-6ff0070a4a31', 'ec6b20ad-c572-4702-9067-5d3918c7b268', '2bb98da7-c89f-4d88-b965-7b4bc17d375a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:12 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-c654e070-66ef-4600-9579-6c8b493312f3-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-c654e070-66ef-4600-9579-6c8b493312f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-c654e070-66ef-4600-9579-6c8b493312f3" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-c654e070-66ef-4600-9579-6c8b493312f3" acquired by "delete_volume" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1709894-d364-429e-b241-4bc1b75629ee]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.383s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleted volume successfully. Sep 23 00:33:12 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 Sep 23 00:33:12 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-94de5feb-c7fc-4ab0-9eda-3f16e62f8a15 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-414ac8c7-8e30-4002-b521-49707d87b4af-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:13 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3" returned: 0 in 0.410s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3 Sep 23 00:33:13 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c654e070-66ef-4600-9579-6c8b493312f3" returned: 0 in 0.261s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-c654e070-66ef-4600-9579-6c8b493312f3" released by "delete_volume" :: held 0.726s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['83eb4f9f-16b7-4bd6-822e-917c939fef40', '0fc98748-d5c9-407d-8f09-3fe2c8880e55', 'ceff1953-e441-4b69-ad74-cd01f1cdd38f', 'c96c5b18-9f2b-4cff-a3b4-fc6c35965faa', '10df3de7-fc20-43e6-9252-3263088d750a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:13 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-94cb7c48-aa65-4323-9d27-fafa0f29e6e0-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-94cb7c48-aa65-4323-9d27-fafa0f29e6e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-94cb7c48-aa65-4323-9d27-fafa0f29e6e0" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:13 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-94cb7c48-aa65-4323-9d27-fafa0f29e6e0" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleted volume successfully. Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d117fd5e-7eb3-4cde-b361-acbcff9e92ab]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-81ab341b-f5b7-420e-b480-98265af047cc tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-c654e070-66ef-4600-9579-6c8b493312f3-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:14 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 Sep 23 00:33:14 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0" returned: 0 in 0.391s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0 Sep 23 00:33:14 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-94cb7c48-aa65-4323-9d27-fafa0f29e6e0" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-94cb7c48-aa65-4323-9d27-fafa0f29e6e0" released by "delete_volume" :: held 0.734s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['c18ba11f-3c81-4962-938c-69d4f2005956', '0f3d99da-0f02-4581-88a1-452f09e75832', '94c6f0a9-2247-4451-a480-e20a035839a4', '67e69cba-0247-4c86-8802-868e5cb92218', 'fe169158-411a-4798-a5ab-f67e57b487b6'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:14 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-3db338da-c76a-483d-82b5-822d0eee15a9-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-3db338da-c76a-483d-82b5-822d0eee15a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-3db338da-c76a-483d-82b5-822d0eee15a9" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:15 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.296s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleted volume successfully. Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-3db338da-c76a-483d-82b5-822d0eee15a9" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2f02c895-4eaa-4f13-9099-a38b57d7cf00 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-94cb7c48-aa65-4323-9d27-fafa0f29e6e0-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b153129-ae8f-42a7-a3ee-80a186a30628]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 Sep 23 00:33:15 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9" returned: 0 in 0.428s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9 Sep 23 00:33:15 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-3db338da-c76a-483d-82b5-822d0eee15a9" returned: 0 in 0.332s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-3db338da-c76a-483d-82b5-822d0eee15a9" released by "delete_volume" :: held 0.821s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['62c37acd-fe08-410a-b47a-2008811d75e3', 'bb00d1f1-f1d6-4314-aba3-00ed2f8a8a49', 'f7381d1f-d803-47da-94c1-2d789ed02f29', '26be7a63-07b7-41d4-aed3-65898ce19ae6', 'eb6aac6a-5825-4698-8574-c8bfd627137c'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:16 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-73357673-2fb4-429f-8f5e-a925742a4318-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-73357673-2fb4-429f-8f5e-a925742a4318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-03520f27-05ca-4473-bd26-6b82f33d7b36" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-03520f27-05ca-4473-bd26-6b82f33d7b36" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-73357673-2fb4-429f-8f5e-a925742a4318" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-73357673-2fb4-429f-8f5e-a925742a4318" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleting offline snapshot 73357673-2fb4-429f-8f5e-a925742a4318 of volume 03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] snapshot_file for this snap is: volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9cd4ff-5277-46e5-b127-26b88cdc2c0d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 Sep 23 00:33:16 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.352s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleted volume successfully. Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5469c27-9c85-4fdc-9847-548e82128982 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-3db338da-c76a-483d-82b5-822d0eee15a9-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:16 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03520f27-05ca-4473-bd26-6b82f33d7b36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe864dd1-5bc4-46c9-8e7d-313ac876ad95]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 Sep 23 00:33:16 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36" returned: 0 in 0.411s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 Sep 23 00:33:17 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318" returned: 0 in 0.434s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318 Sep 23 00:33:17 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36.73357673-2fb4-429f-8f5e-a925742a4318" returned: 0 in 0.313s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-73357673-2fb4-429f-8f5e-a925742a4318" released by "_delete_snapshot" :: held 1.726s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-03520f27-05ca-4473-bd26-6b82f33d7b36" released by "delete_snapshot" :: held 1.763s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['3b608f57-6adc-46e7-bde6-664e0b0c168e', 'b8dfb887-26e9-41b2-9e47-a77f5df5a1d4', '45913135-73e5-4413-a99d-a10625e7499e', '3340e216-f516-4cfe-8f4d-e727cc7be1af', '6eacb14c-866a-48fd-a72b-8c12575d71db'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Delete snapshot completed successfully. Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-707a22da-73be-432e-8140-52dfe6dea338 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-73357673-2fb4-429f-8f5e-a925742a4318-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-03520f27-05ca-4473-bd26-6b82f33d7b36-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-03520f27-05ca-4473-bd26-6b82f33d7b36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "cinder-quobyte-03520f27-05ca-4473-bd26-6b82f33d7b36" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-03520f27-05ca-4473-bd26-6b82f33d7b36" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53159097-789b-4ff9-9a7b-473c943614e3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 Sep 23 00:33:18 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36" returned: 0 in 0.408s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36 Sep 23 00:33:18 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:19 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-03520f27-05ca-4473-bd26-6b82f33d7b36" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-quobyte-03520f27-05ca-4473-bd26-6b82f33d7b36" released by "delete_volume" :: held 0.748s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Created reservations ['18114e0b-3a02-482e-989f-18eb64cd3c46', 'd3923727-0426-435c-aa10-3e4b552e56b3', 'fdface56-e87f-4239-bb2e-1587cdbdaae3', '3e032642-6243-4f37-b07e-f7a4c19f42ef', 'bebe9ccc-36c3-40ee-8334-3ff037632924'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:19 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:19 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:19 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.308s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Deleted volume successfully. Sep 23 00:33:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4c6f8d8b-7a8d-42af-b285-9de9c4fcc8a3 tempest-CreateVolumesFromSnapshotTest-1200403196 None] Lock "cinder-03520f27-05ca-4473-bd26-6b82f33d7b36-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Flow 'volume_create_manager' (6edf0e67-6bd5-4579-bd64-bc791c00e6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9764d263-7a50-4f94-b08e-5d846e321939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9764d263-7a50-4f94-b08e-5d846e321939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868297090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fe0eec-98f7-46a3-b2ff-33baf599bdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2e60b7c14d4e5ea9d2110192f4b1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:23Z,use_quota=True,user_id='fa5afc08afd54457ad4c42ebde8ff1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d844ff90-784b-493f-9fa6-cf3fc3a8269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d844ff90-784b-493f-9fa6-cf3fc3a8269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e891b3d-35ac-43e3-a402-e04a0587275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e891b3d-35ac-43e3-a402-e04a0587275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fe0eec-98f7-46a3-b2ff-33baf599bdcc', 'volume_name': 'volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc3d67a-e1ce-4d76-a5cd-a28272db10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc3d67a-e1ce-4d76-a5cd-a28272db10b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72152dfd-d3a2-4651-84d4-76d9a5f50e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Volume b3fe0eec-98f7-46a3-b2ff-33baf599bdcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc', 'volume_size': 1} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868297090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fe0eec-98f7-46a3-b2ff-33baf599bdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2e60b7c14d4e5ea9d2110192f4b1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:23Z,use_quota=True,user_id='fa5afc08afd54457ad4c42ebde8ff1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Creating volume b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:23 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:23 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc 1073741824 Sep 23 00:33:23 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:23 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc 1073741824" returned: 0 in 0.521s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:24 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc Sep 23 00:33:24 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:24 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72152dfd-d3a2-4651-84d4-76d9a5f50e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3756b6-de5e-43ed-8656-fc7a49ee6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:24 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Volume volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc (b3fe0eec-98f7-46a3-b2ff-33baf599bdcc): created successfully Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3756b6-de5e-43ed-8656-fc7a49ee6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Flow 'volume_create_manager' (6edf0e67-6bd5-4579-bd64-bc791c00e6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:24 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f6e4cc87-2be2-4fb8-a905-17604f567a1a tempest-VolumeDependencyTests-220402972 None] Created volume successfully. Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=78,cinder:UPDATE=105,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=87,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=13 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Creating offline snapshot 780622af-25e0-45f8-8fdc-00bff52cfd43 of volume b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2fc2e-edd6-43ae-a093-283dca09733c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:25 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc Sep 23 00:33:25 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:26 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" returned: 0 in 0.401s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:26 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 1G Sep 23 00:33:26 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:26 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 1G" returned: 0 in 0.441s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:26 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 Sep 23 00:33:26 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:26 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43" returned: 0 in 0.307s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:26 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 is being set with open permissions: ugo+rw Sep 23 00:33:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:26 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 Sep 23 00:33:26 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:27 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43" returned: 0 in 0.279s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info Sep 23 00:33:27 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:27 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info" returned: 0 in 0.295s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info is being set with open permissions: ugo+rw Sep 23 00:33:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info Sep 23 00:33:27 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:27 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.info" returned: 0 in 0.261s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ab4a87e4-b809-4a45-bbc4-ba6334f46238 tempest-VolumeDependencyTests-220402972 None] Create snapshot completed successfully Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Flow 'volume_create_manager' (53981a9a-685e-470e-88b0-f4e4c7aa84ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c116c5-2255-48f4-b1a8-49e578075692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c116c5-2255-48f4-b1a8-49e578075692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1912497748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8d3332-4395-425f-86b7-b4bfc0e2a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2e60b7c14d4e5ea9d2110192f4b1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=780622af-25e0-45f8-8fdc-00bff52cfd43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:29Z,use_quota=True,user_id='fa5afc08afd54457ad4c42ebde8ff1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45400d28-6ac2-4823-b0a3-b78752b42196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45400d28-6ac2-4823-b0a3-b78752b42196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71baad2d-05a5-4e9c-a607-51439ff1e66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71baad2d-05a5-4e9c-a607-51439ff1e66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d8d3332-4395-425f-86b7-b4bfc0e2a706', 'volume_name': 'volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706', 'volume_size': 1, 'snapshot_id': '780622af-25e0-45f8-8fdc-00bff52cfd43'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30078a9d-0cb1-409f-ac95-98f2bae9b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30078a9d-0cb1-409f-ac95-98f2bae9b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5348b2-2043-4a6b-9619-6e822457e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:29 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Volume 0d8d3332-4395-425f-86b7-b4bfc0e2a706: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706', 'volume_size': 1, 'snapshot_id': '780622af-25e0-45f8-8fdc-00bff52cfd43'} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-quobyte-780622af-25e0-45f8-8fdc-00bff52cfd43-0d8d3332-4395-425f-86b7-b4bfc0e2a706" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-780622af-25e0-45f8-8fdc-00bff52cfd43-0d8d3332-4395-425f-86b7-b4bfc0e2a706" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Creating volume 0d8d3332-4395-425f-86b7-b4bfc0e2a706 from snapshot 780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-quobyte-0d8d3332-4395-425f-86b7-b4bfc0e2a706" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-0d8d3332-4395-425f-86b7-b4bfc0e2a706" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] snapshot: 780622af-25e0-45f8-8fdc-00bff52cfd43, volume: 0d8d3332-4395-425f-86b7-b4bfc0e2a706, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e325209-9c75-4931-a91a-6462289d06de]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 Sep 23 00:33:29 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:30 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43" returned: 0 in 0.404s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c272c5-47ae-4024-8e05-99e35018aa70]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:30 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc Sep 23 00:33:30 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:30 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" returned: 0 in 0.477s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:33:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:30 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 Sep 23 00:33:30 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706" returned: 0 in 6.393s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:36 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:36 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Converted 1024.00 MB image at 160.14 MB/s Sep 23 00:33:36 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 is being set with open permissions: ugo+rw Sep 23 00:33:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 Sep 23 00:33:36 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706" returned: 0 in 0.256s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-0d8d3332-4395-425f-86b7-b4bfc0e2a706" released by "_copy_volume_from_snapshot" :: held 7.618s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-780622af-25e0-45f8-8fdc-00bff52cfd43-0d8d3332-4395-425f-86b7-b4bfc0e2a706" released by "_create_volume_from_snapshot" :: held 7.689s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.707s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5348b2-2043-4a6b-9619-6e822457e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706', 'volume_size': 1, 'snapshot_id': '780622af-25e0-45f8-8fdc-00bff52cfd43'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885f03a4-ced6-444b-a3e5-321402419efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Volume volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 (0d8d3332-4395-425f-86b7-b4bfc0e2a706): created successfully Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885f03a4-ced6-444b-a3e5-321402419efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Flow 'volume_create_manager' (53981a9a-685e-470e-88b0-f4e4c7aa84ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a21f3a34-d6d6-4dac-b51f-3f7d1aa5e885 tempest-VolumeDependencyTests-220402972 None] Created volume successfully. Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-780622af-25e0-45f8-8fdc-00bff52cfd43-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Lock "cinder-780622af-25e0-45f8-8fdc-00bff52cfd43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-quobyte-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-quobyte-780622af-25e0-45f8-8fdc-00bff52cfd43" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-780622af-25e0-45f8-8fdc-00bff52cfd43" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Deleting offline snapshot 780622af-25e0-45f8-8fdc-00bff52cfd43 of volume b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] snapshot_file for this snap is: volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bdfcee-7cdb-4121-a1ed-525facbb88e9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 Sep 23 00:33:38 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43" returned: 0 in 0.370s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795eac9-4198-47d1-9edd-860c60d907f6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc Sep 23 00:33:38 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" returned: 0 in 0.511s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 Sep 23 00:33:39 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43" returned: 0 in 0.331s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43 Sep 23 00:33:39 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc.780622af-25e0-45f8-8fdc-00bff52cfd43" returned: 0 in 0.262s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-780622af-25e0-45f8-8fdc-00bff52cfd43" released by "_delete_snapshot" :: held 1.580s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" released by "delete_snapshot" :: held 1.604s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Created reservations ['ac856db7-8334-4477-8398-b057bace6c41', '8a6b25c6-7ae9-4940-8b89-d9c8b126693f', 'e60021d8-bbf2-475b-a17a-4d38f53a53cb', '5f99b010-35a4-4244-bee9-b40d62ac8272', '1c54daca-32d0-477c-846f-baddeab5d340'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Delete snapshot completed successfully. Sep 23 00:33:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-869e9638-a568-461b-96e3-7a767b732e5f tempest-VolumeDependencyTests-220402972 None] Lock "cinder-780622af-25e0-45f8-8fdc-00bff52cfd43-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-quobyte-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b87ccf5-a935-48bb-a4dd-3bb2c921b3a3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc Sep 23 00:33:40 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" returned: 0 in 0.430s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc Sep 23 00:33:40 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" returned: 0 in 0.327s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc" released by "delete_volume" :: held 0.842s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Created reservations ['61883a33-372f-41e2-afd0-89a2f308ac76', 'd598ec04-367f-4575-9898-9f496161a716', '607a452f-62ed-4099-8f18-f381183afefc', '88258820-32d5-4e14-8609-ed29cf1ae166', '88d7e8f1-98bb-4032-a20d-5e02e4be89ed'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:41 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-2db2d1a9-c492-4c04-bbcc-7b3b8e919a80 req-61fbdb7d-8504-4aba-9445-1c3e32542e51 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-2db2d1a9-c492-4c04-bbcc-7b3b8e919a80 req-61fbdb7d-8504-4aba-9445-1c3e32542e51 tempest-TestStampPattern-629110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [req-2db2d1a9-c492-4c04-bbcc-7b3b8e919a80 req-61fbdb7d-8504-4aba-9445-1c3e32542e51 tempest-TestStampPattern-629110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-0d8d3332-4395-425f-86b7-b4bfc0e2a706-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-2db2d1a9-c492-4c04-bbcc-7b3b8e919a80 req-61fbdb7d-8504-4aba-9445-1c3e32542e51 tempest-TestStampPattern-629110055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4', 'name': 'volume-b072753e-6462-468f-b1bf-26538935fc66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '333d09e8-6c9c-4220-94df-3c1f678cf814', 'enforce_multipath': True} {{(pid=87292) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Lock "cinder-0d8d3332-4395-425f-86b7-b4bfc0e2a706-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Acquiring lock "cinder-quobyte-0d8d3332-4395-425f-86b7-b4bfc0e2a706" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-2db2d1a9-c492-4c04-bbcc-7b3b8e919a80 req-61fbdb7d-8504-4aba-9445-1c3e32542e51 tempest-TestStampPattern-629110055 None] attachment_update completed successfully. Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-0d8d3332-4395-425f-86b7-b4bfc0e2a706" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[943ed76e-e307-4055-90ae-3adaa2c1fa2a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.325s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Deleted volume successfully. Sep 23 00:33:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-354d836c-c138-429a-a1b4-7a15ae34f150 tempest-VolumeDependencyTests-220402972 None] Lock "cinder-b3fe0eec-98f7-46a3-b2ff-33baf599bdcc-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:41 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 Sep 23 00:33:41 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706" returned: 0 in 0.425s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706 Sep 23 00:33:42 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-0d8d3332-4395-425f-86b7-b4bfc0e2a706" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Lock "cinder-quobyte-0d8d3332-4395-425f-86b7-b4bfc0e2a706" released by "delete_volume" :: held 0.773s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Created reservations ['bf22aff4-3500-411e-a17c-18808a09793a', '8d8d5ff4-c42d-4856-8dd6-7aeadc5269b1', '466dc49f-0f02-4c18-95b5-8cbd4f2b7c24', 'eff67ad6-63c8-4b3b-b145-761d80e5f2d5', '2b55f111-5615-4995-859f-21bb6c4ab2e5'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:42 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.247s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Deleted volume successfully. Sep 23 00:33:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d53284a0-34b4-4160-bd97-91d2c14817cc tempest-VolumeDependencyTests-220402972 None] Lock "cinder-0d8d3332-4395-425f-86b7-b4bfc0e2a706-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack cinder-volume[87292]: INFO cinder.volume.manager [req-c9dcee8b-5715-44bd-b49b-afaab818d98a req-62d55514-7755-472a-bfc7-d85f9dc90d07 tempest-TestStampPattern-629110055 None] Terminate volume connection completed successfully. Sep 23 00:33:45 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [req-c9dcee8b-5715-44bd-b49b-afaab818d98a req-62d55514-7755-472a-bfc7-d85f9dc90d07 tempest-TestStampPattern-629110055 None] Deleting attachment 333d09e8-6c9c-4220-94df-3c1f678cf814. {{(pid=87292) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Flow 'volume_create_manager' (10795526-c5d7-4318-a44f-24cb8a45588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800212d7-3d49-4299-aeca-dd6fdc3c42b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800212d7-3d49-4299-aeca-dd6fdc3c42b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21898c9-72c3-4690-90c2-9ff017092cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a908b0dab140e88784dc78aef91058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:49Z,use_quota=True,user_id='1ff1f77a45324eeaad119a1a1db0919a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d832c0d2-21f6-46f5-b552-d8ae602989fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d832c0d2-21f6-46f5-b552-d8ae602989fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f84a32-a409-491d-a67a-fa5677dd4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-b072753e-6462-468f-b1bf-26538935fc66-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Lock "cinder-b072753e-6462-468f-b1bf-26538935fc66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-quobyte-b072753e-6462-468f-b1bf-26538935fc66" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-b072753e-6462-468f-b1bf-26538935fc66" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d775361f-2669-4636-adf1-4029f0aaca0f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 Sep 23 00:33:49 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f84a32-a409-491d-a67a-fa5677dd4893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c21898c9-72c3-4690-90c2-9ff017092cd8', 'volume_name': 'volume-c21898c9-72c3-4690-90c2-9ff017092cd8', 'volume_size': 1, 'image_id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea7856d8-008c-4cf6-9104-c6cc583f175f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9cfe3bb5022e84877aa842c822bd1c83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79a908b0dab140e88784dc78aef91058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bedb327286ad0f643b20a654ea7d7c29139ba0501cfdab22569bf5d078f05872783a5c4013f7b0a4b31aabef64ccc43cec69a4343fb04009f24d0ef9a364f79', 'id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea7856d8-008c-4cf6-9104-c6cc583f175f/file', 'properties': {}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65595982-bcc1-4caf-8c82-9cc177e53e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65595982-bcc1-4caf-8c82-9cc177e53e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e4d450-ede9-4d4c-ae2f-a5c14f38ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Volume c21898c9-72c3-4690-90c2-9ff017092cd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c21898c9-72c3-4690-90c2-9ff017092cd8', 'volume_size': 1, 'image_id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea7856d8-008c-4cf6-9104-c6cc583f175f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9cfe3bb5022e84877aa842c822bd1c83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79a908b0dab140e88784dc78aef91058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bedb327286ad0f643b20a654ea7d7c29139ba0501cfdab22569bf5d078f05872783a5c4013f7b0a4b31aabef64ccc43cec69a4343fb04009f24d0ef9a364f79', 'id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea7856d8-008c-4cf6-9104-c6cc583f175f/file', 'properties': {}}, 'image_service': } Sep 23 00:33:49 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Trying to clone c21898c9-72c3-4690-90c2-9ff017092cd8 from image ea7856d8-008c-4cf6-9104-c6cc583f175f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea7856d8-008c-4cf6-9104-c6cc583f175f', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:33:50 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ee4419-babf-4a17-bd9a-7c08a4fe13e7]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66" returned: 0 in 0.409s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66 Sep 23 00:33:50 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD Sep 23 00:33:50 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b072753e-6462-468f-b1bf-26538935fc66" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-b072753e-6462-468f-b1bf-26538935fc66" released by "delete_volume" :: held 0.741s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:50 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Created reservations ['c72f3d34-86b6-4a6e-949c-488597640fbe', '1b6fb276-8c5d-4dca-9b52-44028c436250', 'c0ccb443-470b-4212-9514-883c0cf8d8c0', '997494a4-ed14-4920-9e18-7afbdf823724', '678fb63f-94f1-4d13-8a52-e4febcc7b1ce'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD Sep 23 00:33:50 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:50 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Temporary image ea7856d8-008c-4cf6-9104-c6cc583f175f is fetched for user 1ff1f77a45324eeaad119a1a1db0919a. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:33:50 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.291s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Deleted volume successfully. Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-40251f50-c298-4fc3-bc2b-21b0b1af7f3e tempest-TestStampPattern-629110055 None] Lock "cinder-b072753e-6462-468f-b1bf-26538935fc66-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7896d9-85d8-421e-9a3a-07abcb52c2fb]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-92e43619-4cb4-4535-afc1-f04413ae40a3-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:51 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD Sep 23 00:33:51 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Lock "cinder-92e43619-4cb4-4535-afc1-f04413ae40a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-quobyte-852655c1-c920-477a-92b2-4c1a6f73b58c" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-852655c1-c920-477a-92b2-4c1a6f73b58c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-quobyte-92e43619-4cb4-4535-afc1-f04413ae40a3" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-92e43619-4cb4-4535-afc1-f04413ae40a3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Deleting offline snapshot 92e43619-4cb4-4535-afc1-f04413ae40a3 of volume 852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] snapshot_file for this snap is: volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[480fdec8-e680-4ed3-ab9a-430607fa18a7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 Sep 23 00:33:51 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD Sep 23 00:33:51 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3" returned: 0 in 0.434s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852655c1-c920-477a-92b2-4c1a6f73b58c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1127e245-4356-4c61-83b5-00af79d2bac4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c Sep 23 00:33:51 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21898c9-72c3-4690-90c2-9ff017092cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a908b0dab140e88784dc78aef91058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:49Z,use_quota=True,user_id='1ff1f77a45324eeaad119a1a1db0919a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Creating volume c21898c9-72c3-4690-90c2-9ff017092cd8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:51 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:33:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 1073741824 Sep 23 00:33:51 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 1073741824" returned: 0 in 0.480s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c" returned: 0 in 0.672s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 Sep 23 00:33:52 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 Sep 23 00:33:52 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8" returned: 0 in 0.320s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Attempting download of ea7856d8-008c-4cf6-9104-c6cc583f175f ((None, [{'url': 'file:///opt/stack/data/glance/images/ea7856d8-008c-4cf6-9104-c6cc583f175f', 'metadata': {}}])) to volume c21898c9-72c3-4690-90c2-9ff017092cd8. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0433295-f50e-4e8d-9294-de9e661cbbf3]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3" returned: 0 in 0.470s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3 Sep 23 00:33:52 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6 Sep 23 00:33:52 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c.92e43619-4cb4-4535-afc1-f04413ae40a3" returned: 0 in 0.326s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-92e43619-4cb4-4535-afc1-f04413ae40a3" released by "_delete_snapshot" :: held 2.055s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-852655c1-c920-477a-92b2-4c1a6f73b58c" released by "delete_snapshot" :: held 2.082s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:53 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6" returned: 0 in 0.446s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Created reservations ['2a0fb182-b125-4c53-aa0a-db9af55f5bef', '3a4be7ac-bad1-45a2-b2f7-94c1cfe04030', '12c44ca8-5a74-4ff0-b20e-d6ffdeeb7b2f', '35cb8d57-18bb-4b69-8020-29d5616f9643', '7fdafe26-09cf-449c-ab6c-223d1a372d75'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:53 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6 Sep 23 00:33:53 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Delete snapshot completed successfully. Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-385b22d7-2a5c-420e-a0a7-36a3f62c9a37 tempest-TestStampPattern-629110055 None] Lock "cinder-92e43619-4cb4-4535-afc1-f04413ae40a3-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:53 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6" returned: 1 in 0.469s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea7856d8-008c-4cf6-9104-c6cc583f175f_k64b55e6' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd229291-8969-422d-96cb-83901f5345d5]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD Sep 23 00:33:53 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD Sep 23 00:33:54 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:54 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] ea7856d8-008c-4cf6-9104-c6cc583f175f was raw, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:33:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 Sep 23 00:33:54 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:55 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8" returned: 0 in 0.758s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea7856d8-008c-4cf6-9104-c6cc583f175f_k8lmonlldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:55 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 1G Sep 23 00:33:55 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.351s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:33:55 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 1G" returned: 0 in 0.478s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Downloaded image ea7856d8-008c-4cf6-9104-c6cc583f175f ((None, [{'url': 'file:///opt/stack/data/glance/images/ea7856d8-008c-4cf6-9104-c6cc583f175f', 'metadata': {}}])) to volume c21898c9-72c3-4690-90c2-9ff017092cd8 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Temporary image ea7856d8-008c-4cf6-9104-c6cc583f175f for user 1ff1f77a45324eeaad119a1a1db0919a is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Marking volume c21898c9-72c3-4690-90c2-9ff017092cd8 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Copying metadata from image ea7856d8-008c-4cf6-9104-c6cc583f175f to c21898c9-72c3-4690-90c2-9ff017092cd8. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Creating volume glance metadata for volume c21898c9-72c3-4690-90c2-9ff017092cd8 backed by image ea7856d8-008c-4cf6-9104-c6cc583f175f with: {'image_id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9cfe3bb5022e84877aa842c822bd1c83', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e4d450-ede9-4d4c-ae2f-a5c14f38ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21898c9-72c3-4690-90c2-9ff017092cd8', 'volume_size': 1, 'image_id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea7856d8-008c-4cf6-9104-c6cc583f175f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9cfe3bb5022e84877aa842c822bd1c83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79a908b0dab140e88784dc78aef91058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bedb327286ad0f643b20a654ea7d7c29139ba0501cfdab22569bf5d078f05872783a5c4013f7b0a4b31aabef64ccc43cec69a4343fb04009f24d0ef9a364f79', 'id': 'ea7856d8-008c-4cf6-9104-c6cc583f175f', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea7856d8-008c-4cf6-9104-c6cc583f175f/file', 'properties': {}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7076f77-29f4-424b-ab3f-451f2c56bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:55 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Volume volume-c21898c9-72c3-4690-90c2-9ff017092cd8 (c21898c9-72c3-4690-90c2-9ff017092cd8): created successfully Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7076f77-29f4-424b-ab3f-451f2c56bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Flow 'volume_create_manager' (10795526-c5d7-4318-a44f-24cb8a45588a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ddb0258b-4d91-48c1-9878-0431c9aea2a9 tempest-VolumeImageDependencyTests-1833861375 None] Created volume successfully. Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Acquiring lock "cinder-c21898c9-72c3-4690-90c2-9ff017092cd8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Lock "cinder-c21898c9-72c3-4690-90c2-9ff017092cd8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Acquiring lock "cinder-quobyte-c21898c9-72c3-4690-90c2-9ff017092cd8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Lock "cinder-quobyte-c21898c9-72c3-4690-90c2-9ff017092cd8" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e40d102-801e-454c-8fbf-7d7e2b596e60]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 Sep 23 00:33:57 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8" returned: 0 in 0.436s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8 Sep 23 00:33:57 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c21898c9-72c3-4690-90c2-9ff017092cd8" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Lock "cinder-quobyte-c21898c9-72c3-4690-90c2-9ff017092cd8" released by "delete_volume" :: held 0.749s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Created reservations ['f5773c10-2705-4e8c-8adf-b04213352c12', 'adf747dd-7ce1-4040-80b3-57ab50e18f8d', 'ed8a76b3-ccd0-469e-a161-e56f0fdb8f65', '680ad4b6-b614-4bd1-9d5f-b1bec3ee8ee9', '11c176e0-e1ce-4467-ae10-d01b5c6dbd32'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:58 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-852655c1-c920-477a-92b2-4c1a6f73b58c-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Lock "cinder-852655c1-c920-477a-92b2-4c1a6f73b58c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:58 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.362s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Acquiring lock "cinder-quobyte-852655c1-c920-477a-92b2-4c1a6f73b58c" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Deleted volume successfully. Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-852655c1-c920-477a-92b2-4c1a6f73b58c" acquired by "delete_volume" :: waited 0.078s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fbfa1972-78be-471f-900c-ff2ad397ae83 tempest-VolumeImageDependencyTests-1833861375 None] Lock "cinder-c21898c9-72c3-4690-90c2-9ff017092cd8-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[469b585a-8ea4-4a07-8c84-4ec2c094eb91]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c Sep 23 00:33:58 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c" returned: 0 in 0.440s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c Sep 23 00:33:59 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-852655c1-c920-477a-92b2-4c1a6f73b58c" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Lock "cinder-quobyte-852655c1-c920-477a-92b2-4c1a6f73b58c" released by "delete_volume" :: held 0.827s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Created reservations ['d10ad6b6-38bf-4d93-b854-1d324f853625', '8a95b47d-715e-4512-8eed-4f8135159ddf', 'bcf39a89-8db8-4153-86ae-5eab7cd9dbf9', 'c3590685-b485-4016-8a7e-d78bbb3b58a7', '835683e0-50e7-45dd-ba42-8e854551996d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:33:59 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.284s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Deleted volume successfully. Sep 23 00:34:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-36464536-e2d6-49c8-bba1-6a4dee3f5ea6 tempest-TestStampPattern-629110055 None] Lock "cinder-852655c1-c920-477a-92b2-4c1a6f73b58c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Flow 'volume_create_manager' (65917925-6ad3-4824-a011-4f4ac80dad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a8ffcf-938c-4ed7-9852-309f7c88111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a8ffcf-938c-4ed7-9852-309f7c88111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb359c9-68fe-463a-8989-731e2300a2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700c80de2a7749eeb2382a15ba48e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:03Z,use_quota=True,user_id='8a307f2e6294490c9328afc7c29bf41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80e2259-08d2-4a5e-83c8-b88331cf6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80e2259-08d2-4a5e-83c8-b88331cf6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffe70da-0c44-4d64-959d-7705a170d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffe70da-0c44-4d64-959d-7705a170d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb359c9-68fe-463a-8989-731e2300a2c7', 'volume_name': 'volume-7fb359c9-68fe-463a-8989-731e2300a2c7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e4fcb6-43ce-4abb-b008-aabb6eb5d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e4fcb6-43ce-4abb-b008-aabb6eb5d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c267ba66-02fb-430c-ba80-98e5571cbaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Volume 7fb359c9-68fe-463a-8989-731e2300a2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb359c9-68fe-463a-8989-731e2300a2c7', 'volume_size': 1} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb359c9-68fe-463a-8989-731e2300a2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700c80de2a7749eeb2382a15ba48e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:03Z,use_quota=True,user_id='8a307f2e6294490c9328afc7c29bf41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Creating volume 7fb359c9-68fe-463a-8989-731e2300a2c7 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:02 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 1073741824 Sep 23 00:34:02 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 1073741824" returned: 0 in 0.605s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 Sep 23 00:34:03 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7" returned: 0 in 0.461s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c267ba66-02fb-430c-ba80-98e5571cbaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb359c9-68fe-463a-8989-731e2300a2c7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63636f5b-a02e-46ed-9a9a-a59c0cbc0076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Volume volume-7fb359c9-68fe-463a-8989-731e2300a2c7 (7fb359c9-68fe-463a-8989-731e2300a2c7): created successfully Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63636f5b-a02e-46ed-9a9a-a59c0cbc0076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Flow 'volume_create_manager' (65917925-6ad3-4824-a011-4f4ac80dad1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b99aa6d0-3016-4a03-8c30-88bbe357aa0d tempest-CinderUnicodeTest-226669938 None] Created volume successfully. Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Flow 'volume_create_manager' (fdd0763b-41a4-4470-a180-45ed5af9a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70465feb-8fe1-42d8-96a2-0eec169c41f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70465feb-8fe1-42d8-96a2-0eec169c41f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1083130673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcfbe7b-1268-449e-a2c1-8a052754c88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700c80de2a7749eeb2382a15ba48e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='8a307f2e6294490c9328afc7c29bf41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d1d245-23a6-44e9-ba9e-a5ee5b2d319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d1d245-23a6-44e9-ba9e-a5ee5b2d319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f19eb5-5e5e-4ce8-a5a6-6680d9d6900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f19eb5-5e5e-4ce8-a5a6-6680d9d6900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcfbe7b-1268-449e-a2c1-8a052754c88c', 'volume_name': 'volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4009406-88c9-48b9-85e4-2fd952d4f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4009406-88c9-48b9-85e4-2fd952d4f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494cb386-cb48-4600-9630-67cfe374e27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Volume 6bcfbe7b-1268-449e-a2c1-8a052754c88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c', 'volume_size': 1} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1083130673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcfbe7b-1268-449e-a2c1-8a052754c88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700c80de2a7749eeb2382a15ba48e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='8a307f2e6294490c9328afc7c29bf41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Creating volume 6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:05 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:05 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c 1073741824 Sep 23 00:34:05 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:06 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c 1073741824" returned: 0 in 0.590s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:06 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c Sep 23 00:34:06 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:06 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494cb386-cb48-4600-9630-67cfe374e27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7da46b6-fa1a-4d07-9d29-1d0fe2315442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Volume volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c (6bcfbe7b-1268-449e-a2c1-8a052754c88c): created successfully Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7da46b6-fa1a-4d07-9d29-1d0fe2315442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Flow 'volume_create_manager' (fdd0763b-41a4-4470-a180-45ed5af9a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-68e2ab84-8321-4dba-94de-3173e3ed8bc4 tempest-CinderUnicodeTest-226669938 None] Created volume successfully. Sep 23 00:34:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Creating offline snapshot b3fcc661-10c5-473c-baa0-813cbd86788e of volume 6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5d1223-5f93-4d3c-9758-a4c9783d6d8f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:07 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c Sep 23 00:34:07 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:08 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c" returned: 0 in 0.418s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e 1G Sep 23 00:34:08 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:08 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e 1G" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e Sep 23 00:34:08 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e" returned: 0 in 0.471s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e is being set with open permissions: ugo+rw Sep 23 00:34:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e Sep 23 00:34:09 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info Sep 23 00:34:09 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info" returned: 0 in 0.265s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info is being set with open permissions: ugo+rw Sep 23 00:34:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info Sep 23 00:34:09 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.info" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e22bc801-89ab-4754-8faa-18939185a07b tempest-CinderUnicodeTest-226669938 None] Create snapshot completed successfully Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-b3fcc661-10c5-473c-baa0-813cbd86788e-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Lock "cinder-b3fcc661-10c5-473c-baa0-813cbd86788e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-quobyte-6bcfbe7b-1268-449e-a2c1-8a052754c88c" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-6bcfbe7b-1268-449e-a2c1-8a052754c88c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-quobyte-b3fcc661-10c5-473c-baa0-813cbd86788e" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-b3fcc661-10c5-473c-baa0-813cbd86788e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Deleting offline snapshot b3fcc661-10c5-473c-baa0-813cbd86788e of volume 6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] snapshot_file for this snap is: volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d914e9-fa37-4236-b476-72f8c2bb7b69]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e Sep 23 00:34:11 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e" returned: 0 in 0.431s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b11fe0-fadb-4ee0-b19e-06792f5ce710]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c Sep 23 00:34:11 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c" returned: 0 in 0.415s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e Sep 23 00:34:12 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e" returned: 0 in 0.423s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e Sep 23 00:34:12 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c.b3fcc661-10c5-473c-baa0-813cbd86788e" returned: 0 in 0.284s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-b3fcc661-10c5-473c-baa0-813cbd86788e" released by "_delete_snapshot" :: held 1.707s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-6bcfbe7b-1268-449e-a2c1-8a052754c88c" released by "delete_snapshot" :: held 1.737s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Created reservations ['2278e03f-b46c-420a-a950-6de99825095a', 'aebb1f51-e7ee-4bfa-8eae-7e6cae820c58', 'ca833784-2044-4338-a6c9-c2681c128153', 'b2f7c9b8-2c1e-49a4-84ff-5a6e5d82ce8a', '855118e9-5544-4888-9aa1-8f033e49f6d2'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Delete snapshot completed successfully. Sep 23 00:34:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-759e242a-ac08-4f01-b694-58410225abbb tempest-CinderUnicodeTest-226669938 None] Lock "cinder-b3fcc661-10c5-473c-baa0-813cbd86788e-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-6bcfbe7b-1268-449e-a2c1-8a052754c88c-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-6bcfbe7b-1268-449e-a2c1-8a052754c88c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-quobyte-6bcfbe7b-1268-449e-a2c1-8a052754c88c" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-6bcfbe7b-1268-449e-a2c1-8a052754c88c" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b3897-60a0-4b59-906a-976238b7b17d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c Sep 23 00:34:13 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c Sep 23 00:34:13 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6bcfbe7b-1268-449e-a2c1-8a052754c88c" returned: 0 in 0.296s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-6bcfbe7b-1268-449e-a2c1-8a052754c88c" released by "delete_volume" :: held 0.839s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Created reservations ['1d1c9606-3057-4ff6-b277-c84ad0f71fd0', '25205d0f-166c-467b-b144-a51c7a4944d2', '7c3870c3-3877-4c2b-95d8-6b83eff56825', '4854d8fb-c514-4754-99a3-516cc5f75f39', '182346a6-15dd-4d0c-a525-ecd5d71e5bb4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:14 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-7fb359c9-68fe-463a-8989-731e2300a2c7-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-7fb359c9-68fe-463a-8989-731e2300a2c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "cinder-quobyte-7fb359c9-68fe-463a-8989-731e2300a2c7" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-7fb359c9-68fe-463a-8989-731e2300a2c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[239746af-f6b5-4587-8c94-f6fe41f56f74]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.449s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Deleted volume successfully. Sep 23 00:34:14 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 Sep 23 00:34:14 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e842a40d-42ec-4ec0-ba78-0ed94633a557 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-6bcfbe7b-1268-449e-a2c1-8a052754c88c-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:15 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7" returned: 0 in 0.460s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7 Sep 23 00:34:15 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7fb359c9-68fe-463a-8989-731e2300a2c7" returned: 0 in 0.323s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-quobyte-7fb359c9-68fe-463a-8989-731e2300a2c7" released by "delete_volume" :: held 0.847s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Created reservations ['21d45902-e62d-4992-b293-0bee9503db6b', 'cdb5ae2b-e00d-4efa-b90f-efb04a6566ac', '3d090fe2-bb6d-421d-95d0-a953c1b7ac13', 'e733717d-09c8-4539-9e03-6ec814056a95', 'd69fae2a-a9bb-449b-8916-8a1ccdc2f0d3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:15 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.316s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Deleted volume successfully. Sep 23 00:34:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-92cfc513-b653-4228-9628-dbfb08c11618 tempest-CinderUnicodeTest-226669938 None] Lock "cinder-7fb359c9-68fe-463a-8989-731e2300a2c7-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Flow 'volume_create_manager' (aaaa1d5c-0117-4cb8-aa5a-49b7a9a44e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e48951f-d56d-446f-a063-2e4c113c81cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e48951f-d56d-446f-a063-2e4c113c81cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6025dde-83ca-4eac-88c2-37707177934a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978bff8842f447778286aa3f14e7c031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:19Z,use_quota=True,user_id='e9329ca10c4e495194097ce7f85e9d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d079e34-ed2d-465b-b28c-97def0babf20),volume_type_id=7d079e34-ed2d-465b-b28c-97def0babf20)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab7ddd8-434a-46ac-8011-9bf0ddb866c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab7ddd8-434a-46ac-8011-9bf0ddb866c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2addd87-7f2d-41c8-99f3-126cd9666a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2addd87-7f2d-41c8-99f3-126cd9666a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6025dde-83ca-4eac-88c2-37707177934a', 'volume_name': 'volume-d6025dde-83ca-4eac-88c2-37707177934a', 'volume_size': 1, 'image_id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37da80b84d0d462747306ccc23695ad8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '978bff8842f447778286aa3f14e7c031', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a24255a280e0b94dcb8fc54c58880a77455cd5188b711078067a72f30bb1377eb6774d09f4dd412ecbd84c31b75c58e2d1f2325e27385e5f6b55d507f6a5557', 'id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c707cafc-c131-4058-81dd-4effea11810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c707cafc-c131-4058-81dd-4effea11810c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d490dd-1ef3-4dbb-b823-81674eb1f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Volume d6025dde-83ca-4eac-88c2-37707177934a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6025dde-83ca-4eac-88c2-37707177934a', 'volume_size': 1, 'image_id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37da80b84d0d462747306ccc23695ad8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '978bff8842f447778286aa3f14e7c031', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a24255a280e0b94dcb8fc54c58880a77455cd5188b711078067a72f30bb1377eb6774d09f4dd412ecbd84c31b75c58e2d1f2325e27385e5f6b55d507f6a5557', 'id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Trying to clone d6025dde-83ca-4eac-88c2-37707177934a from image 95bb99ca-5697-4dd6-98f1-16b2510d8cfc at location (None, [{'url': 'file:///opt/stack/data/glance/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:34:19 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8566a59d-eb9b-4f29-857b-5b7d058321fb]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD Sep 23 00:34:19 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD Sep 23 00:34:20 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Temporary image 95bb99ca-5697-4dd6-98f1-16b2510d8cfc is fetched for user e9329ca10c4e495194097ce7f85e9d79. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25dc2c-122e-4ac5-9e64-791400d1b844]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD Sep 23 00:34:20 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD Sep 23 00:34:21 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6025dde-83ca-4eac-88c2-37707177934a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978bff8842f447778286aa3f14e7c031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:19Z,use_quota=True,user_id='e9329ca10c4e495194097ce7f85e9d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d079e34-ed2d-465b-b28c-97def0babf20),volume_type_id=7d079e34-ed2d-465b-b28c-97def0babf20)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Creating volume d6025dde-83ca-4eac-88c2-37707177934a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:21 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a 1073741824 Sep 23 00:34:21 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a 1073741824" returned: 0 in 0.467s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a Sep 23 00:34:21 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a" returned: 0 in 0.265s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Attempting download of 95bb99ca-5697-4dd6-98f1-16b2510d8cfc ((None, [{'url': 'file:///opt/stack/data/glance/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'metadata': {}}])) to volume d6025dde-83ca-4eac-88c2-37707177934a. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2375eb0b-891c-449b-8a40-1425957e1053]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777 Sep 23 00:34:22 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777 Sep 23 00:34:22 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777" returned: 1 in 0.344s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_n4im2777' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c996e6c9-31e9-4310-9434-e0e765b773bd]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD Sep 23 00:34:22 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD Sep 23 00:34:23 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:23 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] 95bb99ca-5697-4dd6-98f1-16b2510d8cfc was raw, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:34:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a Sep 23 00:34:23 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a" returned: 0 in 0.531s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95bb99ca-5697-4dd6-98f1-16b2510d8cfc_6lrh8pjgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:34:24 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a 1G Sep 23 00:34:24 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a 1G" returned: 0 in 0.385s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Downloaded image 95bb99ca-5697-4dd6-98f1-16b2510d8cfc ((None, [{'url': 'file:///opt/stack/data/glance/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'metadata': {}}])) to volume d6025dde-83ca-4eac-88c2-37707177934a successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Temporary image 95bb99ca-5697-4dd6-98f1-16b2510d8cfc for user e9329ca10c4e495194097ce7f85e9d79 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Marking volume d6025dde-83ca-4eac-88c2-37707177934a as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Copying metadata from image 95bb99ca-5697-4dd6-98f1-16b2510d8cfc to d6025dde-83ca-4eac-88c2-37707177934a. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Creating volume glance metadata for volume d6025dde-83ca-4eac-88c2-37707177934a backed by image 95bb99ca-5697-4dd6-98f1-16b2510d8cfc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '37da80b84d0d462747306ccc23695ad8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d490dd-1ef3-4dbb-b823-81674eb1f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6025dde-83ca-4eac-88c2-37707177934a', 'volume_size': 1, 'image_id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37da80b84d0d462747306ccc23695ad8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '978bff8842f447778286aa3f14e7c031', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a24255a280e0b94dcb8fc54c58880a77455cd5188b711078067a72f30bb1377eb6774d09f4dd412ecbd84c31b75c58e2d1f2325e27385e5f6b55d507f6a5557', 'id': '95bb99ca-5697-4dd6-98f1-16b2510d8cfc', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95bb99ca-5697-4dd6-98f1-16b2510d8cfc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b5c80d-1c3c-49c7-887b-5e950daa6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:24 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Volume volume-d6025dde-83ca-4eac-88c2-37707177934a (d6025dde-83ca-4eac-88c2-37707177934a): created successfully Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b5c80d-1c3c-49c7-887b-5e950daa6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Flow 'volume_create_manager' (aaaa1d5c-0117-4cb8-aa5a-49b7a9a44e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:24 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7b6edc39-e9a0-43ac-8941-15f5467e45f2 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Created volume successfully. Sep 23 00:34:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Acquiring lock "cinder-d6025dde-83ca-4eac-88c2-37707177934a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "cinder-d6025dde-83ca-4eac-88c2-37707177934a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Acquiring lock "cinder-quobyte-d6025dde-83ca-4eac-88c2-37707177934a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "cinder-quobyte-d6025dde-83ca-4eac-88c2-37707177934a" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:25 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9a93e-ed7a-44a6-8307-90fff002a1dc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a Sep 23 00:34:25 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a" returned: 0 in 0.456s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a Sep 23 00:34:26 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d6025dde-83ca-4eac-88c2-37707177934a" returned: 0 in 0.300s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "cinder-quobyte-d6025dde-83ca-4eac-88c2-37707177934a" released by "delete_volume" :: held 0.812s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=104,cinder:INSERT=41,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=97,cinder:UPDATE=120,cinder:DELETE=8,cinder:INSERT=35 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:26 devstack cinder-volume[87292]: WARNING cinder.quota [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:34:26 devstack cinder-volume[87292]: WARNING cinder.quota [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Created reservations ['528c9b5a-052f-41cd-aca2-4b388c0f4dda', 'a65c3d0e-c4e5-471f-a265-4166ec9b8396', '7c3a8fdc-1f9d-47bb-a370-fbf8b5851d32', '0c42541e-8b17-49eb-83d0-daadbb5ee3e1', 'c70af0c6-bb8f-4ccd-b318-8fce48ef1229'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:26 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.372s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Deleted volume successfully. Sep 23 00:34:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-37b1379d-9ea9-45e9-99ba-972ca1d14968 tempest-VolumeAndVolumeTypeFromImageTest-1641193813 None] Lock "cinder-d6025dde-83ca-4eac-88c2-37707177934a-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:36 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:INSERT=1,cinder:SELECT=3,cinder:UPDATE=8 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (458b91d6-c0c1-4c9d-9e7f-d651de32a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27832d44-b9ad-4c67-89b0-be8ed3137e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27832d44-b9ad-4c67-89b0-be8ed3137e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565534845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903af5e4-0aa6-40fb-a19a-24c70a261849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:37Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c6b383-ac39-476f-841c-0982a9fa403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c6b383-ac39-476f-841c-0982a9fa403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe51c73-8ecb-4a0f-ae45-8b44f26990aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe51c73-8ecb-4a0f-ae45-8b44f26990aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903af5e4-0aa6-40fb-a19a-24c70a261849', 'volume_name': 'volume-903af5e4-0aa6-40fb-a19a-24c70a261849', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c5be8d-f9b9-48d7-97c1-a8df0812a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c5be8d-f9b9-48d7-97c1-a8df0812a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b999423-051e-481c-9b8c-74afa67575fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Volume 903af5e4-0aa6-40fb-a19a-24c70a261849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903af5e4-0aa6-40fb-a19a-24c70a261849', 'volume_size': 1} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565534845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903af5e4-0aa6-40fb-a19a-24c70a261849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:37Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Creating volume 903af5e4-0aa6-40fb-a19a-24c70a261849 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:37 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 1073741824 Sep 23 00:34:37 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 1073741824" returned: 0 in 0.494s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 Sep 23 00:34:37 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849" returned: 0 in 0.264s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b999423-051e-481c-9b8c-74afa67575fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903af5e4-0aa6-40fb-a19a-24c70a261849', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba78f0f-0e65-49de-800f-37f40ef86db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Volume volume-903af5e4-0aa6-40fb-a19a-24c70a261849 (903af5e4-0aa6-40fb-a19a-24c70a261849): created successfully Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba78f0f-0e65-49de-800f-37f40ef86db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (458b91d6-c0c1-4c9d-9e7f-d651de32a99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d9cb60f4-6bd0-49a3-b271-96a68defa6e4 tempest-ProjectReaderTests-805538541 None] Created volume successfully. Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-903af5e4-0aa6-40fb-a19a-24c70a261849-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Lock "cinder-903af5e4-0aa6-40fb-a19a-24c70a261849-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-quobyte-903af5e4-0aa6-40fb-a19a-24c70a261849" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-903af5e4-0aa6-40fb-a19a-24c70a261849" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df91024c-1faa-4b01-b92b-5a815f4a2706]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 Sep 23 00:34:39 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:39 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849" returned: 0 in 0.406s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:40 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849 Sep 23 00:34:40 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-903af5e4-0aa6-40fb-a19a-24c70a261849" returned: 0 in 0.278s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-903af5e4-0aa6-40fb-a19a-24c70a261849" released by "delete_volume" :: held 0.738s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Created reservations ['dda461b1-f83e-483e-83c3-120eda39b213', 'c9a444d8-540a-4a30-9be8-970095d2df58', 'd184420b-a205-4e5b-9d90-3e95e09566fb', '709f7002-3fd5-46de-bf00-584b5211ae61', '9a604633-b795-4ac9-8cfa-f77fd4f9e559'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:40 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:40 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.251s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Deleted volume successfully. Sep 23 00:34:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e80e773f-547c-45fc-9e26-7f7d69d45b8a tempest-ProjectReaderTests-805538541 None] Lock "cinder-903af5e4-0aa6-40fb-a19a-24c70a261849-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (2a0e33d1-cc4c-4adc-b746-ddc18cfac80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fb5c5b-cb0e-4bfd-a7ab-89bd452518f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fb5c5b-cb0e-4bfd-a7ab-89bd452518f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-599432406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d8a05f-bda1-4de9-b10c-7cb93fe82b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:41Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464196fc-83a9-40ad-ae25-9a4ad2d28029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464196fc-83a9-40ad-ae25-9a4ad2d28029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728cabdd-266e-497d-9002-83d6d75d7a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728cabdd-266e-497d-9002-83d6d75d7a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d8a05f-bda1-4de9-b10c-7cb93fe82b44', 'volume_name': 'volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fadd242-bbff-42d0-8448-98912dce23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fadd242-bbff-42d0-8448-98912dce23a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da925e9-6f94-494e-8efc-a31806f2240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:41 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Volume 47d8a05f-bda1-4de9-b10c-7cb93fe82b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44', 'volume_size': 1} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-599432406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d8a05f-bda1-4de9-b10c-7cb93fe82b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:41Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Creating volume 47d8a05f-bda1-4de9-b10c-7cb93fe82b44 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:41 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 1073741824 Sep 23 00:34:41 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 1073741824" returned: 0 in 0.464s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 Sep 23 00:34:41 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44" returned: 0 in 0.269s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da925e9-6f94-494e-8efc-a31806f2240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45c6a98-7e3b-4686-8eed-8bf3a99f0c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Volume volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 (47d8a05f-bda1-4de9-b10c-7cb93fe82b44): created successfully Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45c6a98-7e3b-4686-8eed-8bf3a99f0c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (2a0e33d1-cc4c-4adc-b746-ddc18cfac80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6f0fb0c2-7d11-4c5b-9f79-f7ea2dc95289 tempest-ProjectReaderTests-805538541 None] Created volume successfully. Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-47d8a05f-bda1-4de9-b10c-7cb93fe82b44-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Lock "cinder-47d8a05f-bda1-4de9-b10c-7cb93fe82b44-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-quobyte-47d8a05f-bda1-4de9-b10c-7cb93fe82b44" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-47d8a05f-bda1-4de9-b10c-7cb93fe82b44" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[080273d8-d122-4907-9232-13a2e4f0c852]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 Sep 23 00:34:42 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44" returned: 0 in 0.409s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44 Sep 23 00:34:42 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-47d8a05f-bda1-4de9-b10c-7cb93fe82b44" returned: 0 in 0.296s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-47d8a05f-bda1-4de9-b10c-7cb93fe82b44" released by "delete_volume" :: held 0.759s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Created reservations ['55560c84-dcaa-4d51-b91e-293409221af4', '827bac52-1512-4720-8b76-5c51fd232238', '56a47a13-1f41-402f-bae7-b2525186d30a', '078f8f15-4433-4b93-a266-f1afac4d0ec9', 'ac120765-496e-47d0-bedd-aef997d8a8ae'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:43 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.344s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Deleted volume successfully. Sep 23 00:34:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f441dccf-de1d-4f96-9cfe-047cf7b9af66 tempest-ProjectReaderTests-805538541 None] Lock "cinder-47d8a05f-bda1-4de9-b10c-7cb93fe82b44-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (38f0bca0-7870-4e6f-a90e-85c2a300aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60481d1e-27df-4f44-b028-a51adeb41676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60481d1e-27df-4f44-b028-a51adeb41676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383725603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d14044-5b57-4aea-a293-b1247d4320db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:44Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a14124-1386-49cb-961e-2e44b56faffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a14124-1386-49cb-961e-2e44b56faffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ca7c95-47ee-4a4b-b663-e1fd2c0c4cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ca7c95-47ee-4a4b-b663-e1fd2c0c4cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d14044-5b57-4aea-a293-b1247d4320db', 'volume_name': 'volume-10d14044-5b57-4aea-a293-b1247d4320db', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fc3036-efb6-4281-9172-0aa09a8b8a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fc3036-efb6-4281-9172-0aa09a8b8a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4b97c5-d610-43c8-9b4a-fd3c780e702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Volume 10d14044-5b57-4aea-a293-b1247d4320db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d14044-5b57-4aea-a293-b1247d4320db', 'volume_size': 1} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383725603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d14044-5b57-4aea-a293-b1247d4320db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:44Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Creating volume 10d14044-5b57-4aea-a293-b1247d4320db {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:44 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:44 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db 1073741824 Sep 23 00:34:44 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:44 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db 1073741824" returned: 0 in 0.469s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:44 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db Sep 23 00:34:44 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:44 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db" returned: 0 in 0.250s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4b97c5-d610-43c8-9b4a-fd3c780e702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d14044-5b57-4aea-a293-b1247d4320db', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e62899-38bc-483a-a68b-a70b36ffedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Volume volume-10d14044-5b57-4aea-a293-b1247d4320db (10d14044-5b57-4aea-a293-b1247d4320db): created successfully Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e62899-38bc-483a-a68b-a70b36ffedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (38f0bca0-7870-4e6f-a90e-85c2a300aa75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:45 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5a82368d-ca2f-4a98-bf08-c8cfe4b16cc7 tempest-ProjectReaderTests-805538541 None] Created volume successfully. Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-10d14044-5b57-4aea-a293-b1247d4320db-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Lock "cinder-10d14044-5b57-4aea-a293-b1247d4320db-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-quobyte-10d14044-5b57-4aea-a293-b1247d4320db" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-10d14044-5b57-4aea-a293-b1247d4320db" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[08537bc7-9e50-4025-92ed-0b9ee26d9a43]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db Sep 23 00:34:46 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db" returned: 0 in 0.405s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db Sep 23 00:34:46 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-10d14044-5b57-4aea-a293-b1247d4320db" returned: 0 in 0.252s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-10d14044-5b57-4aea-a293-b1247d4320db" released by "delete_volume" :: held 0.707s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Created reservations ['1ef96128-9566-4517-a344-ccd6f19caf99', '2454158e-c5f0-4aee-ac4e-c638a4d3b043', '26312781-f4dd-44fb-97d9-192c4f0def2b', '4b5cd81f-b5c7-4236-8dbd-f854b8f6c9e6', '715c1178-737e-438a-9438-f94889a1fddb'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:47 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.291s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Deleted volume successfully. Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b2d5b8c2-96af-4edc-997c-59d99e982b07 tempest-ProjectReaderTests-805538541 None] Lock "cinder-10d14044-5b57-4aea-a293-b1247d4320db-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (2f07b784-9899-4e1d-a837-190a78c1dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd617c6-b5e4-43fc-967b-c89a76a69f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd617c6-b5e4-43fc-967b-c89a76a69f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862939350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04b32ed-ecb7-457b-8af2-fac800d0c7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:48Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c180c8-8c2b-41ce-9300-97a50780f74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c180c8-8c2b-41ce-9300-97a50780f74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0af666e-a2e3-4123-9951-0d84c0834d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0af666e-a2e3-4123-9951-0d84c0834d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04b32ed-ecb7-457b-8af2-fac800d0c7eb', 'volume_name': 'volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d133261a-2837-4c16-8587-8c350b624ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d133261a-2837-4c16-8587-8c350b624ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77965227-e732-4730-966f-3ea25e436767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Volume c04b32ed-ecb7-457b-8af2-fac800d0c7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb', 'volume_size': 1} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862939350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04b32ed-ecb7-457b-8af2-fac800d0c7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59981a7261e54f908b2d7ce57733bb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:48Z,use_quota=True,user_id='acc9d482833c47f38769ddfa26a0bc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Creating volume c04b32ed-ecb7-457b-8af2-fac800d0c7eb {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:48 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb 1073741824 Sep 23 00:34:48 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb 1073741824" returned: 0 in 0.487s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb Sep 23 00:34:48 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77965227-e732-4730-966f-3ea25e436767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22724828-d2c6-48c5-affc-4630c9c02440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Volume volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb (c04b32ed-ecb7-457b-8af2-fac800d0c7eb): created successfully Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22724828-d2c6-48c5-affc-4630c9c02440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Flow 'volume_create_manager' (2f07b784-9899-4e1d-a837-190a78c1dcec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-69c2d98f-0f72-41e0-90a9-c6b26c8b5374 tempest-ProjectReaderTests-805538541 None] Created volume successfully. Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-c04b32ed-ecb7-457b-8af2-fac800d0c7eb-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Lock "cinder-c04b32ed-ecb7-457b-8af2-fac800d0c7eb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Acquiring lock "cinder-quobyte-c04b32ed-ecb7-457b-8af2-fac800d0c7eb" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-c04b32ed-ecb7-457b-8af2-fac800d0c7eb" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bbbd47-fdd5-4068-9de1-97aedaa230f8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:50 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb Sep 23 00:34:50 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:50 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb" returned: 0 in 0.404s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:50 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb Sep 23 00:34:50 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:50 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c04b32ed-ecb7-457b-8af2-fac800d0c7eb" returned: 0 in 0.259s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Lock "cinder-quobyte-c04b32ed-ecb7-457b-8af2-fac800d0c7eb" released by "delete_volume" :: held 0.715s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:50 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Created reservations ['a378b01a-0059-4cc4-b509-4eb8d56638ad', '947ea344-578f-4ba9-85e3-080e633938bc', '1e1619bc-06e8-409e-b6af-b22ebab4b83f', '685df4d4-ee6c-4d79-a8f2-30f42c2bf536', '4b8e6566-73b0-4f25-95c7-465454695ccf'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:51 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:51 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:51 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.301s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Deleted volume successfully. Sep 23 00:34:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53716d84-418c-43d4-a1a2-fbfb01baea34 tempest-ProjectReaderTests-805538541 None] Lock "cinder-c04b32ed-ecb7-457b-8af2-fac800d0c7eb-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:55 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:34:55 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:55 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.403s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:34:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:35:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:DELETE=5,cinder:INSERT=11 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=31,cinder:INSERT=13,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Flow 'volume_create_manager' (ee1ebc0f-a9b8-446a-8aa1-134f81d9bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9163b32-a1f1-43dd-bc34-9766789fec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9163b32-a1f1-43dd-bc34-9766789fec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-489024338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e20ba00-68f3-4d9d-bf2f-c2a914544042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363b0684705445e89c4f0e461cfede46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:18Z,use_quota=True,user_id='2452874d049f42c9a78abe82ab69a91e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b58186-b1c6-40d5-8c25-964a4bb0a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b58186-b1c6-40d5-8c25-964a4bb0a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fd214e-eb2e-42ed-841a-bac111369ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fd214e-eb2e-42ed-841a-bac111369ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e20ba00-68f3-4d9d-bf2f-c2a914544042', 'volume_name': 'volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f0c6d-034c-4fd0-bb26-938ae4048969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f0c6d-034c-4fd0-bb26-938ae4048969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673d20f-1813-44e1-98f3-4985c97831b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Volume 6e20ba00-68f3-4d9d-bf2f-c2a914544042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042', 'volume_size': 1} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-489024338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e20ba00-68f3-4d9d-bf2f-c2a914544042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363b0684705445e89c4f0e461cfede46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:18Z,use_quota=True,user_id='2452874d049f42c9a78abe82ab69a91e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Creating volume 6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:17 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:35:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 1073741824 Sep 23 00:35:17 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:18 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 1073741824" returned: 0 in 0.433s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:18 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 Sep 23 00:35:18 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:18 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042" returned: 0 in 0.254s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673d20f-1813-44e1-98f3-4985c97831b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbe31c0-02a7-408b-8eb8-1b7e1fd500b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Volume volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 (6e20ba00-68f3-4d9d-bf2f-c2a914544042): created successfully Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbe31c0-02a7-408b-8eb8-1b7e1fd500b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Flow 'volume_create_manager' (ee1ebc0f-a9b8-446a-8aa1-134f81d9bacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-16ca7f85-27ec-4106-8b90-1fc189584cd1 tempest-SnapshotDependencyTests-744160897 None] Created volume successfully. Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Creating offline snapshot 1a95493e-ca86-45d1-979c-136ee06e1af5 of volume 6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec0d89-3fcf-42b0-ad9a-bc34fc34b0ac]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 Sep 23 00:35:19 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:19 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042" returned: 0 in 0.389s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 1G Sep 23 00:35:19 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:19 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 1G" returned: 0 in 0.412s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 Sep 23 00:35:19 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5" returned: 0 in 0.309s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 is being set with open permissions: ugo+rw Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:20 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 Sep 23 00:35:20 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5" returned: 0 in 0.255s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:20 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info Sep 23 00:35:20 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info" returned: 0 in 0.269s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info is being set with open permissions: ugo+rw Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:20 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info Sep 23 00:35:20 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.info" returned: 0 in 0.263s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-56b2f0fb-20a1-4c68-ba5a-f198e4dd8487 tempest-SnapshotDependencyTests-744160897 None] Create snapshot completed successfully Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Flow 'volume_create_manager' (69452677-17c1-4db2-9b47-31e69031be2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e52c5c6-26a4-4a0e-b100-f49555e8f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e52c5c6-26a4-4a0e-b100-f49555e8f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea22e88-df20-4d8f-89dc-04859512973a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363b0684705445e89c4f0e461cfede46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a95493e-ca86-45d1-979c-136ee06e1af5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:22Z,use_quota=True,user_id='2452874d049f42c9a78abe82ab69a91e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2232164-17cc-43ba-8987-e9be477da839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2232164-17cc-43ba-8987-e9be477da839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2e02a4-af45-4033-acc2-420435ab6eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2e02a4-af45-4033-acc2-420435ab6eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cea22e88-df20-4d8f-89dc-04859512973a', 'volume_name': 'volume-cea22e88-df20-4d8f-89dc-04859512973a', 'volume_size': 1, 'snapshot_id': '1a95493e-ca86-45d1-979c-136ee06e1af5'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a9edeb-10ed-4cc7-91ba-2349b13ed7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a9edeb-10ed-4cc7-91ba-2349b13ed7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cb8a8b-942a-4c44-95f5-e4b7ee5a984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:21 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Volume cea22e88-df20-4d8f-89dc-04859512973a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cea22e88-df20-4d8f-89dc-04859512973a', 'volume_size': 1, 'snapshot_id': '1a95493e-ca86-45d1-979c-136ee06e1af5'} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-quobyte-1a95493e-ca86-45d1-979c-136ee06e1af5-cea22e88-df20-4d8f-89dc-04859512973a" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-1a95493e-ca86-45d1-979c-136ee06e1af5-cea22e88-df20-4d8f-89dc-04859512973a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Creating volume cea22e88-df20-4d8f-89dc-04859512973a from snapshot 1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-quobyte-cea22e88-df20-4d8f-89dc-04859512973a" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-cea22e88-df20-4d8f-89dc-04859512973a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] snapshot: 1a95493e-ca86-45d1-979c-136ee06e1af5, volume: cea22e88-df20-4d8f-89dc-04859512973a, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead20620-d35c-4fee-94a9-7521a1493418]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 Sep 23 00:35:21 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:22 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[51117d93-7ce6-4c98-84b5-dec8c1deeaac]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:22 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 Sep 23 00:35:22 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:22 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042" returned: 0 in 0.373s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:35:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:22 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a Sep 23 00:35:22 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:28 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a" returned: 0 in 5.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:35:28 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Converted 1024.00 MB image at 185.32 MB/s Sep 23 00:35:28 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a is being set with open permissions: ugo+rw Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:28 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a Sep 23 00:35:28 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:28 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a" returned: 0 in 0.269s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-cea22e88-df20-4d8f-89dc-04859512973a" released by "_copy_volume_from_snapshot" :: held 6.621s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-1a95493e-ca86-45d1-979c-136ee06e1af5-cea22e88-df20-4d8f-89dc-04859512973a" released by "_create_volume_from_snapshot" :: held 6.690s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.708s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cb8a8b-942a-4c44-95f5-e4b7ee5a984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea22e88-df20-4d8f-89dc-04859512973a', 'volume_size': 1, 'snapshot_id': '1a95493e-ca86-45d1-979c-136ee06e1af5'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168823fc-c132-4243-86a8-3e02881a88e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:28 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Volume volume-cea22e88-df20-4d8f-89dc-04859512973a (cea22e88-df20-4d8f-89dc-04859512973a): created successfully Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168823fc-c132-4243-86a8-3e02881a88e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Flow 'volume_create_manager' (69452677-17c1-4db2-9b47-31e69031be2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:28 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e65edc03-78bb-4c80-9864-fbbe6835afe7 tempest-SnapshotDependencyTests-744160897 None] Created volume successfully. Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-1a95493e-ca86-45d1-979c-136ee06e1af5-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-1a95493e-ca86-45d1-979c-136ee06e1af5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-quobyte-6e20ba00-68f3-4d9d-bf2f-c2a914544042" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-6e20ba00-68f3-4d9d-bf2f-c2a914544042" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-quobyte-1a95493e-ca86-45d1-979c-136ee06e1af5" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-1a95493e-ca86-45d1-979c-136ee06e1af5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Deleting offline snapshot 1a95493e-ca86-45d1-979c-136ee06e1af5 of volume 6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] snapshot_file for this snap is: volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d92a01-eaa1-4f04-bccc-43157ea731b6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:29 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 Sep 23 00:35:29 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:29 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5" returned: 0 in 0.467s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87662d91-cff2-492f-83eb-031397731273]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:29 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 Sep 23 00:35:29 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:30 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042" returned: 0 in 0.593s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:30 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 Sep 23 00:35:30 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:30 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5" returned: 0 in 0.384s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:30 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5 Sep 23 00:35:30 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042.1a95493e-ca86-45d1-979c-136ee06e1af5" returned: 0 in 0.277s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-1a95493e-ca86-45d1-979c-136ee06e1af5" released by "_delete_snapshot" :: held 1.827s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-6e20ba00-68f3-4d9d-bf2f-c2a914544042" released by "delete_snapshot" :: held 1.850s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Created reservations ['22d5e397-12fc-4c96-92bf-13cfbd11d067', '765aca52-3b3f-4a8b-a346-f64aa4611709', 'c241667a-d4a6-46d8-aa5a-12825d1009db', '1bc27f2f-d638-427b-86b5-1797e2966c59', 'c8711e8c-77ab-4afa-aa92-1a4d955f748e'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:35:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Delete snapshot completed successfully. Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-12a7bdec-1e49-4534-a57c-35d81aa1792c tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-1a95493e-ca86-45d1-979c-136ee06e1af5-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-6e20ba00-68f3-4d9d-bf2f-c2a914544042-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-6e20ba00-68f3-4d9d-bf2f-c2a914544042-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-quobyte-6e20ba00-68f3-4d9d-bf2f-c2a914544042" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-6e20ba00-68f3-4d9d-bf2f-c2a914544042" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff6c5e-2ef0-485a-acc9-4f29dcc790a5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 Sep 23 00:35:31 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042" returned: 0 in 0.396s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042 Sep 23 00:35:31 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6e20ba00-68f3-4d9d-bf2f-c2a914544042" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-6e20ba00-68f3-4d9d-bf2f-c2a914544042" released by "delete_volume" :: held 0.741s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Created reservations ['a6e438eb-e4f9-4086-9c01-47a24cbb690c', 'b911b2f1-3fd8-4883-97a2-2426f510f43d', '83975448-b189-4a13-9a56-4a02db07012c', '5235e875-62d4-42fd-9fbd-3708372e5069', '7cdd547a-b105-49b8-aaea-abff1d374e23'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:35:32 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-cea22e88-df20-4d8f-89dc-04859512973a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-cea22e88-df20-4d8f-89dc-04859512973a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "cinder-quobyte-cea22e88-df20-4d8f-89dc-04859512973a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-cea22e88-df20-4d8f-89dc-04859512973a" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:32 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.284s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:32 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Deleted volume successfully. Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06030b-0607-469d-8e30-376545736bd7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-61468ff8-792f-4233-989c-379d08ce7443 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-6e20ba00-68f3-4d9d-bf2f-c2a914544042-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:32 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a Sep 23 00:35:32 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a Sep 23 00:35:33 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cea22e88-df20-4d8f-89dc-04859512973a" returned: 0 in 0.246s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-quobyte-cea22e88-df20-4d8f-89dc-04859512973a" released by "delete_volume" :: held 0.651s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Created reservations ['6226f8bd-1a80-4e23-992f-e1af7c4efe36', '51bdba6e-f6f3-4118-9d75-1263b8fb073b', '08948f70-4c11-48b7-849f-2e7a69d59b24', 'd5acb612-7f9d-44c8-94c8-a5b727b4b399', 'ce613bc4-8746-47fe-ab96-79656f688237'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:35:33 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.256s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Deleted volume successfully. Sep 23 00:35:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3e4dabbd-0d2d-4161-b882-b41eecb04a44 tempest-SnapshotDependencyTests-744160897 None] Lock "cinder-cea22e88-df20-4d8f-89dc-04859512973a-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:43 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=31,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:43 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:55 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:35:55 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:55 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.280s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:35:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Flow 'volume_create_manager' (c9e9af48-a2b8-4f46-bdf7-a5b583e578b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46a7b96-8f89-4cfe-b595-2c4e503c672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46a7b96-8f89-4cfe-b595-2c4e503c672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1066959992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23739735-1a44-4c29-bc91-69e62efdfe1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f7c9cc4df54389bc69eaf553f8919b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:01Z,use_quota=True,user_id='fea3b1122d7840d79e53825b35629790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657635f9-0be9-438b-8863-9c535f37bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657635f9-0be9-438b-8863-9c535f37bd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abf5505-fc92-440a-b113-c6641cfc5d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abf5505-fc92-440a-b113-c6641cfc5d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23739735-1a44-4c29-bc91-69e62efdfe1e', 'volume_name': 'volume-23739735-1a44-4c29-bc91-69e62efdfe1e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c266699c-b316-41d8-b5bc-1adaafb18494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c266699c-b316-41d8-b5bc-1adaafb18494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f74da67-0457-4e43-b088-408ea295dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Volume 23739735-1a44-4c29-bc91-69e62efdfe1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23739735-1a44-4c29-bc91-69e62efdfe1e', 'volume_size': 1} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1066959992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23739735-1a44-4c29-bc91-69e62efdfe1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f7c9cc4df54389bc69eaf553f8919b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:01Z,use_quota=True,user_id='fea3b1122d7840d79e53825b35629790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Creating volume 23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:01 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:01 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e 1073741824 Sep 23 00:36:01 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (ff7ccb5e-fb02-450e-ab03-8756e141769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfaec48-c3be-4745-84f1-3dcd7dd2ed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfaec48-c3be-4745-84f1-3dcd7dd2ed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649733073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcebe50a-15a7-468d-903c-4ef101d23d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:02Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa3e2a1-9152-4352-9360-7157426206c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa3e2a1-9152-4352-9360-7157426206c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f13b39-bfc2-4791-a7d3-95727429804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f13b39-bfc2-4791-a7d3-95727429804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcebe50a-15a7-468d-903c-4ef101d23d2e', 'volume_name': 'volume-bcebe50a-15a7-468d-903c-4ef101d23d2e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520b3486-62b2-4f8c-ad5b-913df32af44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520b3486-62b2-4f8c-ad5b-913df32af44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1558979-bbb7-4005-a438-e89e469441b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Volume bcebe50a-15a7-468d-903c-4ef101d23d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcebe50a-15a7-468d-903c-4ef101d23d2e', 'volume_size': 1} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9739cb56-3a4c-40f3-ab4f-7066c782ffe7 tempest-ProjectAdminTests-1242808270 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87292) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:36:02 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e 1073741824" returned: 0 in 0.661s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:02 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e Sep 23 00:36:02 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (df51b5f7-0ee8-4824-aa45-0832bc5e883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8033a546-fe1e-4553-86c1-0820e0ed2264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8033a546-fe1e-4553-86c1-0820e0ed2264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139361854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8eda62c-ac43-42b1-9526-2a5aeffce2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:02Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db7fe6a-d14c-408b-b407-d3a19fae61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db7fe6a-d14c-408b-b407-d3a19fae61ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b3537f-b446-47a4-bb9b-415cf37e08fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b3537f-b446-47a4-bb9b-415cf37e08fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8eda62c-ac43-42b1-9526-2a5aeffce2b6', 'volume_name': 'volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71da78b7-328a-4fda-8a13-1a100b05cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71da78b7-328a-4fda-8a13-1a100b05cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b23f7-1e22-431e-89ff-37147fe6bb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Volume a8eda62c-ac43-42b1-9526-2a5aeffce2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6', 'volume_size': 1} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:02 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e" returned: 0 in 0.384s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649733073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcebe50a-15a7-468d-903c-4ef101d23d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:02Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Creating volume bcebe50a-15a7-468d-903c-4ef101d23d2e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:02 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:02 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e 1073741824 Sep 23 00:36:02 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f74da67-0457-4e43-b088-408ea295dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23739735-1a44-4c29-bc91-69e62efdfe1e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f01048-072a-4e15-8375-f540ed508af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Volume volume-23739735-1a44-4c29-bc91-69e62efdfe1e (23739735-1a44-4c29-bc91-69e62efdfe1e): created successfully Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f01048-072a-4e15-8375-f540ed508af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Flow 'volume_create_manager' (c9e9af48-a2b8-4f46-bdf7-a5b583e578b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cfea31f5-f5d3-4657-a424-b07a865b2537 tempest-VolumeDependencyTests-2008638229 None] Created volume successfully. Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (fcda4212-b3ad-483c-b008-ee8899d9832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de724d20-d6b2-4739-804f-7a0c05485cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de724d20-d6b2-4739-804f-7a0c05485cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207906594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d53e102-6047-4f96-b607-cb5e6b46bce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:03Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7d7088-9160-4eeb-8d1b-c0f247ae432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7d7088-9160-4eeb-8d1b-c0f247ae432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537d2e7b-da95-4839-8c0b-f79e02c4b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537d2e7b-da95-4839-8c0b-f79e02c4b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d53e102-6047-4f96-b607-cb5e6b46bce9', 'volume_name': 'volume-4d53e102-6047-4f96-b607-cb5e6b46bce9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c592bce9-0b9f-4bea-b077-7592621efdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c592bce9-0b9f-4bea-b077-7592621efdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e287fa-bfd5-44e1-b614-6ce1cd519258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Volume 4d53e102-6047-4f96-b607-cb5e6b46bce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d53e102-6047-4f96-b607-cb5e6b46bce9', 'volume_size': 1} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:03 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e 1073741824" returned: 0 in 0.822s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (07e77f68-8d90-4e52-9cbd-96e7da0a1013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58796e6-6278-490f-b3b4-246a635e537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58796e6-6278-490f-b3b4-246a635e537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1959139459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a632f1c-12bd-4445-9139-f8dff8f91ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:03Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e Sep 23 00:36:03 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83c8b74-fb58-4fb7-bf3b-7fa2d88fd102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83c8b74-fb58-4fb7-bf3b-7fa2d88fd102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0c8960-2cc1-4e44-a34d-ebe88c11f02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0c8960-2cc1-4e44-a34d-ebe88c11f02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a632f1c-12bd-4445-9139-f8dff8f91ff7', 'volume_name': 'volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b25f97d-2451-4015-98cd-1191fe304a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b25f97d-2451-4015-98cd-1191fe304a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d797f2-6238-489b-a04b-46b7313a8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Volume 8a632f1c-12bd-4445-9139-f8dff8f91ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7', 'volume_size': 1} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:03 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e" returned: 0 in 0.307s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139361854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8eda62c-ac43-42b1-9526-2a5aeffce2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:02Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Creating volume a8eda62c-ac43-42b1-9526-2a5aeffce2b6 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:03 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 1073741824 Sep 23 00:36:03 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1558979-bbb7-4005-a438-e89e469441b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcebe50a-15a7-468d-903c-4ef101d23d2e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3538a0-9109-4d07-b645-289a7ded0336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Volume volume-bcebe50a-15a7-468d-903c-4ef101d23d2e (bcebe50a-15a7-468d-903c-4ef101d23d2e): created successfully Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3538a0-9109-4d07-b645-289a7ded0336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (ff7ccb5e-fb02-450e-ab03-8756e141769b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:04 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3a6a2053-30ff-4136-87d1-79bd2b597dcd tempest-CreateVolumesFromImageTest-978678857 None] Created volume successfully. Sep 23 00:36:04 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 1073741824" returned: 0 in 0.692s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:04 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 Sep 23 00:36:04 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:04 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (95e2fa5c-3dac-451b-b989-9a72271fecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1637eab0-3afd-4a5f-b50b-990fb81ac159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:05 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6" returned: 0 in 0.362s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207906594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d53e102-6047-4f96-b607-cb5e6b46bce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:03Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Creating volume 4d53e102-6047-4f96-b607-cb5e6b46bce9 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:05 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:05 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 1073741824 Sep 23 00:36:05 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1637eab0-3afd-4a5f-b50b-990fb81ac159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328459202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a595d-962c-4ce4-a19c-3da4c22765a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:05Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da0b4d5-5496-427a-a2f6-7fad21fdad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da0b4d5-5496-427a-a2f6-7fad21fdad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff50532-dada-40b1-a026-048f12378713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff50532-dada-40b1-a026-048f12378713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5a595d-962c-4ce4-a19c-3da4c22765a1', 'volume_name': 'volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8880d0f-16ee-4ede-b44d-4a1e6ac9e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8880d0f-16ee-4ede-b44d-4a1e6ac9e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997493e5-07c7-458b-be0c-328f43e68825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Volume 4f5a595d-962c-4ce4-a19c-3da4c22765a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1', 'volume_size': 1} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b23f7-1e22-431e-89ff-37147fe6bb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d96a568-b2e6-48d1-a9b9-bcf8767ef494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Volume volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 (a8eda62c-ac43-42b1-9526-2a5aeffce2b6): created successfully Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d96a568-b2e6-48d1-a9b9-bcf8767ef494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (df51b5f7-0ee8-4824-aa45-0832bc5e883d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-761d5043-ff86-4247-84bc-4f5954b9d373 tempest-CreateVolumesFromImageTest-978678857 None] Created volume successfully. Sep 23 00:36:05 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 1073741824" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:05 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 Sep 23 00:36:05 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:05 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.300s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1959139459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a632f1c-12bd-4445-9139-f8dff8f91ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:03Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Creating volume 8a632f1c-12bd-4445-9139-f8dff8f91ff7 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:05 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e287fa-bfd5-44e1-b614-6ce1cd519258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d53e102-6047-4f96-b607-cb5e6b46bce9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c368f3-a8d5-463a-98f1-7fa0ee0bb5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:06 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 1073741824 Sep 23 00:36:06 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Volume volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 (4d53e102-6047-4f96-b607-cb5e6b46bce9): created successfully Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c368f3-a8d5-463a-98f1-7fa0ee0bb5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (fcda4212-b3ad-483c-b008-ee8899d9832b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7ad77065-2451-4a46-92a1-0992396c82b3 tempest-CreateVolumesFromImageTest-978678857 None] Created volume successfully. Sep 23 00:36:06 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 1073741824" returned: 0 in 0.570s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:06 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 Sep 23 00:36:06 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:06 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7" returned: 0 in 0.267s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.113s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Creating offline snapshot da1ca203-33c9-4008-a121-b805575e01b9 of volume 23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d797f2-6238-489b-a04b-46b7313a8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52497300-95bd-4bbc-929f-d61f63c9eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b266f7-5299-4cc4-9cfd-8a40639add98]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Volume volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 (8a632f1c-12bd-4445-9139-f8dff8f91ff7): created successfully Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52497300-95bd-4bbc-929f-d61f63c9eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (07e77f68-8d90-4e52-9cbd-96e7da0a1013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-468715bd-2098-4960-bb12-425072f0e1d5 tempest-CreateVolumesFromImageTest-978678857 None] Created volume successfully. Sep 23 00:36:07 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e Sep 23 00:36:07 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Flow 'volume_create_manager' (e4a734b3-31e7-418b-ba90-ce8c4c77fdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d45d99-a552-4b90-baee-eb3f4366de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d45d99-a552-4b90-baee-eb3f4366de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4618b7c3-43a9-4b0e-819e-3f5548ad7446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fbb13e3cac49ba91ffc5ef0f07ce68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:07Z,use_quota=True,user_id='9c4af38bdfe64c928ac7b63ba849bb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53812bdf-2ec2-433a-a4ab-e7d541a0129b),volume_type_id=53812bdf-2ec2-433a-a4ab-e7d541a0129b)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c486e5cc-747f-40d8-9158-5694b02f76a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c486e5cc-747f-40d8-9158-5694b02f76a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fa54b2-bef0-424a-9d65-2498f201d27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:36:07 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e" returned: 0 in 0.511s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:07 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 1G Sep 23 00:36:07 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fa54b2-bef0-424a-9d65-2498f201d27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4618b7c3-43a9-4b0e-819e-3f5548ad7446', 'volume_name': 'volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446', 'volume_size': 1, 'image_id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ffd83911daeee75a852010f97aa500b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61fbb13e3cac49ba91ffc5ef0f07ce68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e64ae0ba86d2ef1e32ffc5ac06310cafaa4247e825a03388b15656cdb8b3f64b2a2a17f9a5cffa6a0aa512ec09876548eea2a1d8f91dfe2d9da9f1128440a12a', 'id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f1c2b0-3b58-4eb7-8156-add9cd51329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f1c2b0-3b58-4eb7-8156-add9cd51329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dc5ceb-255f-4754-a0c4-af93044dc3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Volume 4618b7c3-43a9-4b0e-819e-3f5548ad7446: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446', 'volume_size': 1, 'image_id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ffd83911daeee75a852010f97aa500b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61fbb13e3cac49ba91ffc5ef0f07ce68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e64ae0ba86d2ef1e32ffc5ac06310cafaa4247e825a03388b15656cdb8b3f64b2a2a17f9a5cffa6a0aa512ec09876548eea2a1d8f91dfe2d9da9f1128440a12a', 'id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Trying to clone 4618b7c3-43a9-4b0e-819e-3f5548ad7446 from image 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:36:07 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:36:07 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 1G" returned: 0 in 0.530s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23739735-1a44-4c29-bc91-69e62efdfe1e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[699209ec-7e35-4299-873e-2422d4295033]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23739735-1a44-4c29-bc91-69e62efdfe1e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 Sep 23 00:36:08 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD Sep 23 00:36:08 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23739735-1a44-4c29-bc91-69e62efdfe1e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9" returned: 0 in 0.419s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:08 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 is being set with open permissions: ugo+rw Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 Sep 23 00:36:08 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD Sep 23 00:36:08 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9" returned: 0 in 0.281s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info Sep 23 00:36:08 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Temporary image 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 is fetched for user 9c4af38bdfe64c928ac7b63ba849bb67. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e2c4c2-512b-433b-840e-66f0257c7403]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD Sep 23 00:36:08 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info" returned: 0 in 0.333s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info is being set with open permissions: ugo+rw Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info Sep 23 00:36:09 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.info" returned: 0 in 0.286s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.237s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:09 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD Sep 23 00:36:09 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328459202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a595d-962c-4ce4-a19c-3da4c22765a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bbd99554754573848c715dd84bcf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:05Z,use_quota=True,user_id='5133f42778e841478701e322634fd572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Creating volume 4f5a595d-962c-4ce4-a19c-3da4c22765a1 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:09 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 1073741824 Sep 23 00:36:09 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a840b906-fdc5-4a25-a19e-3da1738895cd tempest-VolumeDependencyTests-2008638229 None] Create snapshot completed successfully Sep 23 00:36:09 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:10 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 1073741824" returned: 0 in 0.617s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:10 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 Sep 23 00:36:10 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:10 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1" returned: 0 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4618b7c3-43a9-4b0e-819e-3f5548ad7446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fbb13e3cac49ba91ffc5ef0f07ce68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:07Z,use_quota=True,user_id='9c4af38bdfe64c928ac7b63ba849bb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53812bdf-2ec2-433a-a4ab-e7d541a0129b),volume_type_id=53812bdf-2ec2-433a-a4ab-e7d541a0129b)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Creating volume 4618b7c3-43a9-4b0e-819e-3f5548ad7446 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:10 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997493e5-07c7-458b-be0c-328f43e68825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 1073741824 Sep 23 00:36:10 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b476ccc-184b-4299-9b2d-1a5786a66d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Volume volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 (4f5a595d-962c-4ce4-a19c-3da4c22765a1): created successfully Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b476ccc-184b-4299-9b2d-1a5786a66d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Flow 'volume_create_manager' (95e2fa5c-3dac-451b-b989-9a72271fecb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c83a0d5a-fb91-4ff0-9e33-c99ebdbf3fb8 tempest-CreateVolumesFromImageTest-978678857 None] Created volume successfully. Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Flow 'volume_create_manager' (64d25479-c6e0-4205-b967-cf57e478f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158b1adb-fe37-44d2-a320-b179683eccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158b1adb-fe37-44d2-a320-b179683eccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1950467732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2d90dc-7855-453a-9b49-5cc356d65aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f7c9cc4df54389bc69eaf553f8919b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da1ca203-33c9-4008-a121-b805575e01b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:11Z,use_quota=True,user_id='fea3b1122d7840d79e53825b35629790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be41fb0-f70c-4932-a375-c7f0b5b60369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be41fb0-f70c-4932-a375-c7f0b5b60369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fb50cc-9ec6-48b0-a6c3-ddc4963659f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fb50cc-9ec6-48b0-a6c3-ddc4963659f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc2d90dc-7855-453a-9b49-5cc356d65aeb', 'volume_name': 'volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb', 'volume_size': 1, 'snapshot_id': 'da1ca203-33c9-4008-a121-b805575e01b9'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7793003-92d4-4412-bf85-485d17ccdb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7793003-92d4-4412-bf85-485d17ccdb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c748ef-bd42-432b-b380-118af6e1820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:11 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Volume bc2d90dc-7855-453a-9b49-5cc356d65aeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb', 'volume_size': 1, 'snapshot_id': 'da1ca203-33c9-4008-a121-b805575e01b9'} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:11 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 1073741824" returned: 0 in 0.604s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:11 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 Sep 23 00:36:11 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:11 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.376s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-quobyte-da1ca203-33c9-4008-a121-b805575e01b9-bc2d90dc-7855-453a-9b49-5cc356d65aeb" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-da1ca203-33c9-4008-a121-b805575e01b9-bc2d90dc-7855-453a-9b49-5cc356d65aeb" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Creating volume bc2d90dc-7855-453a-9b49-5cc356d65aeb from snapshot da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-quobyte-bc2d90dc-7855-453a-9b49-5cc356d65aeb" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Attempting download of 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 ((None, [{'url': 'file:///opt/stack/data/glance/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'metadata': {}}])) to volume 4618b7c3-43a9-4b0e-819e-3f5548ad7446. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-bc2d90dc-7855-453a-9b49-5cc356d65aeb" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] snapshot: da1ca203-33c9-4008-a121-b805575e01b9, volume: bc2d90dc-7855-453a-9b49-5cc356d65aeb, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[778250e5-36b1-41ec-8117-1e0448acf026]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fcc444-0ff4-4861-8845-ed37356ea65c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:11 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly Sep 23 00:36:11 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:11 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 Sep 23 00:36:11 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-4f5a595d-962c-4ce4-a19c-3da4c22765a1-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-4f5a595d-962c-4ce4-a19c-3da4c22765a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-quobyte-4f5a595d-962c-4ce4-a19c-3da4c22765a1" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-4f5a595d-962c-4ce4-a19c-3da4c22765a1" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:11 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly" returned: 0 in 0.427s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75275e-5e3b-4e45-9c93-5784ec91a6a3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9" returned: 0 in 0.504s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23739735-1a44-4c29-bc91-69e62efdfe1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fdeec2-25c2-4bf8-8cfd-2434c073832d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly Sep 23 00:36:12 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 Sep 23 00:36:12 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e Sep 23 00:36:12 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly" returned: 1 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30__7dsloly' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866fc7c-1cfe-42f7-b6a7-4c416cffa370]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1 Sep 23 00:36:12 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD Sep 23 00:36:12 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e" returned: 0 in 0.464s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb Sep 23 00:36:12 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4f5a595d-962c-4ce4-a19c-3da4c22765a1" returned: 0 in 0.328s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-4f5a595d-962c-4ce4-a19c-3da4c22765a1" released by "delete_volume" :: held 0.854s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Created reservations ['2bd1f4b2-36e5-4e07-a568-79f3ed23cefa', '436c95b6-9d97-44c0-ae4a-eb0a7c7478ba', '7d0faa54-14c5-434d-bf4a-c8ecaf3995e7', '5d38ad13-3259-45cd-a4fb-cb5a41122ca9', 'be4af40f-3ddd-49eb-84d2-197383c4a955'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:12 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD Sep 23 00:36:12 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:13 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-8a632f1c-12bd-4445-9139-f8dff8f91ff7-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-8a632f1c-12bd-4445-9139-f8dff8f91ff7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-quobyte-8a632f1c-12bd-4445-9139-f8dff8f91ff7" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-8a632f1c-12bd-4445-9139-f8dff8f91ff7" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e852b07-6a98-4baf-a2ea-2cafdac71878]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 was raw, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 Sep 23 00:36:13 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 Sep 23 00:36:13 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Deleted volume successfully. Sep 23 00:36:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0e163878-f7b3-4c3e-862e-f0f881b83528 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-4f5a595d-962c-4ce4-a19c-3da4c22765a1-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:14 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7" returned: 0 in 1.106s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:14 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7 Sep 23 00:36:14 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-8a632f1c-12bd-4445-9139-f8dff8f91ff7" returned: 0 in 0.536s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446" returned: 0 in 1.499s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30_pyv9t7rfdevstack@QuobyteHD, size 0.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:15 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-8a632f1c-12bd-4445-9139-f8dff8f91ff7" released by "delete_volume" :: held 1.732s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:15 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 1G Sep 23 00:36:15 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Created reservations ['54d832a4-0c69-4eab-9bf1-cfd0382a8f53', 'bcae4063-bca7-43ab-9066-0ce4f034a460', '79cfe7ac-5bda-4b97-b595-0dd9fb94658d', '50911962-19eb-4360-893b-6239763b8230', 'f8a2fa3b-3bd0-4d7f-940c-1ff18c8772ec'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:15 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:15 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-4d53e102-6047-4f96-b607-cb5e6b46bce9-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:15 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-4d53e102-6047-4f96-b607-cb5e6b46bce9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 1G" returned: 0 in 0.676s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Downloaded image 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 ((None, [{'url': 'file:///opt/stack/data/glance/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'metadata': {}}])) to volume 4618b7c3-43a9-4b0e-819e-3f5548ad7446 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Temporary image 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 for user 9c4af38bdfe64c928ac7b63ba849bb67 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Marking volume 4618b7c3-43a9-4b0e-819e-3f5548ad7446 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Copying metadata from image 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 to 4618b7c3-43a9-4b0e-819e-3f5548ad7446. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Creating volume glance metadata for volume 4618b7c3-43a9-4b0e-819e-3f5548ad7446 backed by image 303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8ffd83911daeee75a852010f97aa500b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-quobyte-4d53e102-6047-4f96-b607-cb5e6b46bce9" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-4d53e102-6047-4f96-b607-cb5e6b46bce9" acquired by "delete_volume" :: waited 0.064s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989bfb7-746f-483c-901f-53ab4d9912e6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dc5ceb-255f-4754-a0c4-af93044dc3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446', 'volume_size': 1, 'image_id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ffd83911daeee75a852010f97aa500b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61fbb13e3cac49ba91ffc5ef0f07ce68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e64ae0ba86d2ef1e32ffc5ac06310cafaa4247e825a03388b15656cdb8b3f64b2a2a17f9a5cffa6a0aa512ec09876548eea2a1d8f91dfe2d9da9f1128440a12a', 'id': '303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/303ba3e3-8dc0-47a8-bfc0-c852fd8b9d30/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428dc2b3-0421-48bc-b824-57f00ebde31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:16 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Volume volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 (4618b7c3-43a9-4b0e-819e-3f5548ad7446): created successfully Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428dc2b3-0421-48bc-b824-57f00ebde31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Flow 'volume_create_manager' (e4a734b3-31e7-418b-ba90-ce8c4c77fdbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-e9b1b57f-406d-44a0-9e84-b3dc5744fcec tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Created volume successfully. Sep 23 00:36:16 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.659s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:16 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Deleted volume successfully. Sep 23 00:36:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c13a78af-d7be-49a2-8e43-d827a0c14d87 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-8a632f1c-12bd-4445-9139-f8dff8f91ff7-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:16 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 Sep 23 00:36:16 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9" returned: 0 in 1.014s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9 Sep 23 00:36:17 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Acquiring lock "cinder-4618b7c3-43a9-4b0e-819e-3f5548ad7446-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "cinder-4618b7c3-43a9-4b0e-819e-3f5548ad7446-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Acquiring lock "cinder-quobyte-4618b7c3-43a9-4b0e-819e-3f5548ad7446" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "cinder-quobyte-4618b7c3-43a9-4b0e-819e-3f5548ad7446" acquired by "delete_volume" :: waited 0.030s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27470de-06c1-4489-950e-d5690a4ef142]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4d53e102-6047-4f96-b607-cb5e6b46bce9" returned: 0 in 0.623s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-4d53e102-6047-4f96-b607-cb5e6b46bce9" released by "delete_volume" :: held 1.778s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Created reservations ['f07ddc82-1a93-4269-a162-26301a2434a4', '1974213f-133a-4684-8529-7063bb56eb80', 'd1b7d0e7-7e8b-4944-8ceb-5c5cd657bcff', 'c85122c1-9134-4789-a5c4-5ec5ba8166f3', '12ea62f1-b308-4bce-9ac9-e8f561ef0440'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:17 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 Sep 23 00:36:17 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:18 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-a8eda62c-ac43-42b1-9526-2a5aeffce2b6-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-a8eda62c-ac43-42b1-9526-2a5aeffce2b6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-quobyte-a8eda62c-ac43-42b1-9526-2a5aeffce2b6" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-a8eda62c-ac43-42b1-9526-2a5aeffce2b6" acquired by "delete_volume" :: waited 0.047s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75d7bd-a347-4eb0-8450-e67b89704b92]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446" returned: 0 in 1.044s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.705s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:18 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446 Sep 23 00:36:18 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Deleted volume successfully. Sep 23 00:36:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-89268542-eb69-45d0-84ab-353555e65759 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-4d53e102-6047-4f96-b607-cb5e6b46bce9-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:18 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 Sep 23 00:36:18 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4618b7c3-43a9-4b0e-819e-3f5548ad7446" returned: 0 in 0.678s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "cinder-quobyte-4618b7c3-43a9-4b0e-819e-3f5548ad7446" released by "delete_volume" :: held 1.854s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Created reservations ['fbac2d1f-52fb-459b-bec1-d9f2ce6c8784', '19c80823-3291-44b7-968d-1d1d0fb640f8', 'f6fcc4eb-ecc4-4b02-b469-84ffad083193', '83dabd87-f262-414a-bf39-17fb0ffc22e9', '2184c79d-9563-422c-90f5-4f2a540fc1b1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:19 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6" returned: 0 in 1.050s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6 Sep 23 00:36:19 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:19 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:20 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a8eda62c-ac43-42b1-9526-2a5aeffce2b6" returned: 0 in 0.626s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-a8eda62c-ac43-42b1-9526-2a5aeffce2b6" released by "delete_volume" :: held 1.801s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Created reservations ['fc5bb19e-46df-4870-8624-33421989567b', '0eb39600-1c60-43c0-9e85-84d404c9fb85', 'dc623d79-c6fd-4fca-afb0-e767abcc263f', '7fcbafda-57be-47f6-9f4c-bc7fe5b5b530', 'ee200106-123f-453d-b3ca-baf6fce5c2f3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:20 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.801s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Deleted volume successfully. Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c49110d0-1f7e-4209-8b52-60da49b8dff4 tempest-VolumeAndVolumeTypeFromImageTest-735692166 None] Lock "cinder-4618b7c3-43a9-4b0e-819e-3f5548ad7446-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:20 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:20 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-bcebe50a-15a7-468d-903c-4ef101d23d2e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-bcebe50a-15a7-468d-903c-4ef101d23d2e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "cinder-quobyte-bcebe50a-15a7-468d-903c-4ef101d23d2e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-bcebe50a-15a7-468d-903c-4ef101d23d2e" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5060e6d0-9e23-4298-8528-57e364962a47]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:21 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.747s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:21 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Deleted volume successfully. Sep 23 00:36:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b81bf61d-dd0f-44cb-85f4-4216f467596e tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-a8eda62c-ac43-42b1-9526-2a5aeffce2b6-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:21 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e Sep 23 00:36:21 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e" returned: 0 in 1.126s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e Sep 23 00:36:22 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb" returned: 0 in 9.926s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:22 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Converted 1024.00 MB image at 103.15 MB/s Sep 23 00:36:22 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb is being set with open permissions: ugo+rw Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb Sep 23 00:36:22 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bcebe50a-15a7-468d-903c-4ef101d23d2e" returned: 0 in 0.391s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-quobyte-bcebe50a-15a7-468d-903c-4ef101d23d2e" released by "delete_volume" :: held 1.631s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:22 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Created reservations ['bf040ad6-8919-4925-8940-9cf2f45c69b9', 'ed265dae-e37d-4fc2-b87c-9494ba0a8392', 'e4dc32c3-01f2-4f36-9ff8-0a8b6dbd813e', '0b0568d4-90d1-45ce-8ed8-006bc3fb1f6a', '9767e224-40d5-4cb0-97dd-df5df74f6117'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-bc2d90dc-7855-453a-9b49-5cc356d65aeb" released by "_copy_volume_from_snapshot" :: held 11.307s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-da1ca203-33c9-4008-a121-b805575e01b9-bc2d90dc-7855-453a-9b49-5cc356d65aeb" released by "_create_volume_from_snapshot" :: held 11.408s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.434s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c748ef-bd42-432b-b380-118af6e1820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb', 'volume_size': 1, 'snapshot_id': 'da1ca203-33c9-4008-a121-b805575e01b9'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f8c980-e634-4420-8ce9-2637a660ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Volume volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb (bc2d90dc-7855-453a-9b49-5cc356d65aeb): created successfully Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f8c980-e634-4420-8ce9-2637a660ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Flow 'volume_create_manager' (64d25479-c6e0-4205-b967-cf57e478f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:22 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8309fcc0-088d-4df8-957b-337b837f8c0e tempest-VolumeDependencyTests-2008638229 None] Created volume successfully. Sep 23 00:36:22 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:23 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.311s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:23 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Deleted volume successfully. Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ac23042c-c1f9-47e7-b7fb-828220acde81 tempest-CreateVolumesFromImageTest-978678857 None] Lock "cinder-bcebe50a-15a7-468d-903c-4ef101d23d2e-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-da1ca203-33c9-4008-a121-b805575e01b9-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-da1ca203-33c9-4008-a121-b805575e01b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-quobyte-23739735-1a44-4c29-bc91-69e62efdfe1e" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-23739735-1a44-4c29-bc91-69e62efdfe1e" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-quobyte-da1ca203-33c9-4008-a121-b805575e01b9" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-da1ca203-33c9-4008-a121-b805575e01b9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Deleting offline snapshot da1ca203-33c9-4008-a121-b805575e01b9 of volume 23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] snapshot_file for this snap is: volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8fcec3-7b8c-437c-9383-977d5378359b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:23 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 Sep 23 00:36:23 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9" returned: 0 in 0.530s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23739735-1a44-4c29-bc91-69e62efdfe1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3dc0ea-40e6-4985-b5c7-e9c3f1269775]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e Sep 23 00:36:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (3398c314-828a-4f18-8c84-0ed3e8c0718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5e5f93-5891-462c-b7a0-01784a3b7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5e5f93-5891-462c-b7a0-01784a3b7171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805376532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f851f556-c224-4461-8d53-6b95905c1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f851f556-c224-4461-8d53-6b95905c1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a3f896-8822-4df4-bad2-bdaef4d1c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a3f896-8822-4df4-bad2-bdaef4d1c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1', 'volume_name': 'volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d12e5cc-f3a4-4030-8429-648b8ae8ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d12e5cc-f3a4-4030-8429-648b8ae8ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95356458-0dce-40d8-9e6d-915b526629b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Volume 92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1', 'volume_size': 1} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805376532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Creating volume 92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:24 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 1073741824 Sep 23 00:36:24 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e" returned: 0 in 0.734s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 Sep 23 00:36:24 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:25 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 1073741824" returned: 0 in 0.635s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:25 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 Sep 23 00:36:25 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:25 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9" returned: 0 in 0.502s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:25 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9 Sep 23 00:36:25 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:25 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1" returned: 0 in 0.327s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95356458-0dce-40d8-9e6d-915b526629b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbd01ff-b201-4d2d-9d41-faa1c0179cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Volume volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 (92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1): created successfully Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbd01ff-b201-4d2d-9d41-faa1c0179cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (3398c314-828a-4f18-8c84-0ed3e8c0718f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b05a44f1-6651-46fe-bcaa-d94a8bf78005 tempest-ProjectReaderTests-1112016546 None] Created volume successfully. Sep 23 00:36:25 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e.da1ca203-33c9-4008-a121-b805575e01b9" returned: 0 in 0.347s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-da1ca203-33c9-4008-a121-b805575e01b9" released by "_delete_snapshot" :: held 2.267s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-23739735-1a44-4c29-bc91-69e62efdfe1e" released by "delete_snapshot" :: held 2.309s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:25 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Created reservations ['153d2a75-4e60-4173-9248-a773b791dbe0', '660a385a-6349-4f67-8701-744faaf6affa', '247ec2fc-9a38-4b66-82b4-0bb2da6560a0', '43693ad0-3ad8-42db-84fd-2b103b944713', '0671877e-8630-4508-90de-e66b42029582'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:26 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Delete snapshot completed successfully. Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-366f442a-7f92-4c2f-ae59-dca8b2f9e22c tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-da1ca203-33c9-4008-a121-b805575e01b9-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-23739735-1a44-4c29-bc91-69e62efdfe1e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-23739735-1a44-4c29-bc91-69e62efdfe1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-quobyte-23739735-1a44-4c29-bc91-69e62efdfe1e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-23739735-1a44-4c29-bc91-69e62efdfe1e" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7594e-4edf-4049-9579-05da1443c2e3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e Sep 23 00:36:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-quobyte-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2f49c-6363-46f6-b2d0-0252cfe0035e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e" returned: 0 in 0.561s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 Sep 23 00:36:27 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e Sep 23 00:36:27 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1" returned: 0 in 0.487s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1 Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-23739735-1a44-4c29-bc91-69e62efdfe1e" returned: 0 in 0.420s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-23739735-1a44-4c29-bc91-69e62efdfe1e" released by "delete_volume" :: held 1.091s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Created reservations ['e4b6c7c3-0f53-4f2d-8c97-4f5daa305896', '201ba9cb-b9ad-48ed-8126-babba8800e7b', '6c40572f-7d3c-4d53-b63b-d2b802bb2841', '7ceef9ed-61f9-4c38-a201-9a3887a704bf', '4f52bf18-a4bd-4ebe-8f52-e1caee1e39c5'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:28 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1" released by "delete_volume" :: held 0.870s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (c76961bc-2bdd-47a1-a342-f2d76cc082d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addb9a52-a8cb-4098-a548-6439517a73c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addb9a52-a8cb-4098-a548-6439517a73c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228058905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:28Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61585805-2ded-45c8-8747-84b9521b83ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61585805-2ded-45c8-8747-84b9521b83ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf29d636-6bdb-4e4f-a278-de0dd1ef7e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf29d636-6bdb-4e4f-a278-de0dd1ef7e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631', 'volume_name': 'volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eeeecab-a2b9-498d-8071-94d86cb17043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eeeecab-a2b9-498d-8071-94d86cb17043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e0c1b-b7d6-4951-b22a-68956a2fe8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631', 'volume_size': 1} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228058905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:28Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Creating volume de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:28 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Created reservations ['fff23ed1-7b24-4913-a2fe-bd67aade0efa', '830b233f-3941-4424-b905-d79234890ef8', 'e1c1344d-0653-4938-aaa6-63a9220e64c3', '46189d8c-2a9d-4a09-8afd-3eb3c220c337', '368e1381-758c-4da7-afd8-9a7ea557d4b1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:28 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 1073741824 Sep 23 00:36:28 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:28 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (5b30e789-8184-439f-ba2c-9ed81fcc5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c336d5-32ce-4c70-bac2-34c277d7c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.312s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c336d5-32ce-4c70-bac2-34c277d7c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981941363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156a11c5-4c7c-40a3-9170-f82cd473cd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:28Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d61adf-db24-4241-b299-c82a35b7b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d61adf-db24-4241-b299-c82a35b7b255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8c3763-556f-4c84-98c4-6870b2167db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8c3763-556f-4c84-98c4-6870b2167db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '156a11c5-4c7c-40a3-9170-f82cd473cd70', 'volume_name': 'volume-156a11c5-4c7c-40a3-9170-f82cd473cd70', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612706a3-536a-433c-956a-7ee39d4e8124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612706a3-536a-433c-956a-7ee39d4e8124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ace4a7-9706-4bd1-8c98-7c7d34ed28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume 156a11c5-4c7c-40a3-9170-f82cd473cd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-156a11c5-4c7c-40a3-9170-f82cd473cd70', 'volume_size': 1} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Deleted volume successfully. Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55136668-3503-41c7-b258-5fcab9682301 tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-23739735-1a44-4c29-bc91-69e62efdfe1e-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:28 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 1073741824" returned: 0 in 0.454s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.271s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:28 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Deleted volume successfully. Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 Sep 23 00:36:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-51ceb980-426d-444e-b1e3-b559ed811fc2 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-92ec3878-55b3-4ad5-b5f6-e5b8eab31ca1-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:28 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-bc2d90dc-7855-453a-9b49-5cc356d65aeb-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-bc2d90dc-7855-453a-9b49-5cc356d65aeb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "cinder-quobyte-bc2d90dc-7855-453a-9b49-5cc356d65aeb" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:29 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-bc2d90dc-7855-453a-9b49-5cc356d65aeb" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631" returned: 0 in 0.321s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981941363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156a11c5-4c7c-40a3-9170-f82cd473cd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:28Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating volume 156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:29 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d09c9-9e41-4d0f-94ad-9c2a9a783ab2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 1073741824 Sep 23 00:36:29 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e0c1b-b7d6-4951-b22a-68956a2fe8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353a23d2-7b04-46a6-b282-d9e1194427af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:29 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 (de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631): created successfully Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353a23d2-7b04-46a6-b282-d9e1194427af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (c76961bc-2bdd-47a1-a342-f2d76cc082d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:29 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9233322f-4320-42bf-ba9c-d0731d8e37a6 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created volume successfully. Sep 23 00:36:29 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb Sep 23 00:36:29 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb" returned: 0 in 0.452s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 1073741824" returned: 0 in 0.495s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:29 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb Sep 23 00:36:29 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 Sep 23 00:36:29 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bc2d90dc-7855-453a-9b49-5cc356d65aeb" returned: 0 in 0.309s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-quobyte-bc2d90dc-7855-453a-9b49-5cc356d65aeb" released by "delete_volume" :: held 0.848s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:30 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70" returned: 0 in 0.350s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ace4a7-9706-4bd1-8c98-7c7d34ed28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-156a11c5-4c7c-40a3-9170-f82cd473cd70', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945ed1e4-f3b9-43b6-9efb-c6feaa403599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Created reservations ['3d46d062-b803-4d75-93aa-21d602c2668b', 'f2970110-9ca2-4dab-90cc-2cb3938d055d', 'fc7b651a-f648-44a3-af28-f51641d55ec9', 'f08d8abe-6b12-4658-b2f5-945c9a7c475a', 'dece1103-a151-46e5-a42c-1dae18a8ec63'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (4d678730-1960-4bac-bc6e-d06991e06272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c25635-0910-4cf3-86d1-00296d4c4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:30 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 (156a11c5-4c7c-40a3-9170-f82cd473cd70): created successfully Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945ed1e4-f3b9-43b6-9efb-c6feaa403599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (5b30e789-8184-439f-ba2c-9ed81fcc5f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c25635-0910-4cf3-86d1-00296d4c4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780744810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520a1fae-df91-46aa-9802-718deaab804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:30Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d60745c-7efd-4394-8163-1a50bc068e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d60745c-7efd-4394-8163-1a50bc068e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbc5761-e403-41a9-9259-a01a7b9de7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbc5761-e403-41a9-9259-a01a7b9de7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520a1fae-df91-46aa-9802-718deaab804f', 'volume_name': 'volume-520a1fae-df91-46aa-9802-718deaab804f', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef6c8e3-ab63-4773-bf8e-6f3f4191af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef6c8e3-ab63-4773-bf8e-6f3f4191af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c914168a-8565-4479-bece-7d49391aedce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:30 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Volume 520a1fae-df91-46aa-9802-718deaab804f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520a1fae-df91-46aa-9802-718deaab804f', 'volume_size': 1} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780744810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520a1fae-df91-46aa-9802-718deaab804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:30Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Creating volume 520a1fae-df91-46aa-9802-718deaab804f {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:30 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0717d471-912b-4c11-a7c4-39cfb7fe5546 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created volume successfully. Sep 23 00:36:30 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f 1073741824 Sep 23 00:36:30 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:30 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Deleted volume successfully. Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b369c923-d37d-43ac-9146-62264c97a61d tempest-VolumeDependencyTests-2008638229 None] Lock "cinder-bc2d90dc-7855-453a-9b49-5cc356d65aeb-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f 1073741824" returned: 0 in 0.646s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:31 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f Sep 23 00:36:31 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (6178566a-ebee-476f-97ca-e27e00d8857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2417d7b1-ddae-41e6-8438-2e24068da83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2417d7b1-ddae-41e6-8438-2e24068da83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935720842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab07552-33c5-41e7-b6f9-2d7bdb4daf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:31Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e0167f-7db0-4351-9221-37132a38a647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e0167f-7db0-4351-9221-37132a38a647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a9472a-eebe-4aad-91f9-f30858bdca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a9472a-eebe-4aad-91f9-f30858bdca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab07552-33c5-41e7-b6f9-2d7bdb4daf0b', 'volume_name': 'volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f5c6ef-32a6-4971-a907-4ade63295c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f5c6ef-32a6-4971-a907-4ade63295c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987f2ee5-96fc-4fe3-bfda-187ab1ab24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume fab07552-33c5-41e7-b6f9-2d7bdb4daf0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b', 'volume_size': 1} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:31 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f" returned: 0 in 0.345s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.214s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935720842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab07552-33c5-41e7-b6f9-2d7bdb4daf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:31Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Creating volume fab07552-33c5-41e7-b6f9-2d7bdb4daf0b {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:31 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c914168a-8565-4479-bece-7d49391aedce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520a1fae-df91-46aa-9802-718deaab804f', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b 1073741824 Sep 23 00:36:31 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c81991-d4dd-422d-a418-4d8c3dd8fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Volume volume-520a1fae-df91-46aa-9802-718deaab804f (520a1fae-df91-46aa-9802-718deaab804f): created successfully Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c81991-d4dd-422d-a418-4d8c3dd8fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (4d678730-1960-4bac-bc6e-d06991e06272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-db0e7e77-4b8d-4658-95fe-f3fd846ba494 tempest-ProjectReaderTests-1112016546 None] Created volume successfully. Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (cb990caa-edfa-4549-95ae-f4d78128b4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bf9f2e-dd0a-4788-89f9-c73a8323b0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bf9f2e-dd0a-4788-89f9-c73a8323b0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-160440572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2006cf3a-6ee1-4793-98ce-ca38f537fe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:31Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b473d6-f34d-47ce-8ee7-9289d5823048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b473d6-f34d-47ce-8ee7-9289d5823048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a9d22a-6a04-4380-99b3-1668ed451ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a9d22a-6a04-4380-99b3-1668ed451ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2006cf3a-6ee1-4793-98ce-ca38f537fe9a', 'volume_name': 'volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0afab33-236c-4c64-8a01-27d950810c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0afab33-236c-4c64-8a01-27d950810c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc41b5-22c4-4886-8800-ea2a87f90e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume 2006cf3a-6ee1-4793-98ce-ca38f537fe9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a', 'volume_size': 1} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:31 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:32 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b 1073741824" returned: 0 in 0.679s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b Sep 23 00:36:32 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (999ca240-1127-4d4a-8e70-36003349b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6b00ce-36fc-4c2f-8d13-e0ce7ce1b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6b00ce-36fc-4c2f-8d13-e0ce7ce1b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62145473-1205-4d06-9739-331bcd4a8876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:32Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd855528-e87b-4251-aa2f-f7f00401edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd855528-e87b-4251-aa2f-f7f00401edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1deca4a-5856-47cb-9c9e-6946ced29a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1deca4a-5856-47cb-9c9e-6946ced29a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62145473-1205-4d06-9739-331bcd4a8876', 'volume_name': 'volume-62145473-1205-4d06-9739-331bcd4a8876', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b6358-7801-4b57-a380-cb7963bd01c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b6358-7801-4b57-a380-cb7963bd01c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537498f8-77c6-4f1b-8ac1-6de045b43f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume 62145473-1205-4d06-9739-331bcd4a8876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62145473-1205-4d06-9739-331bcd4a8876', 'volume_size': 1} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:32 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b" returned: 0 in 0.327s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-160440572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2006cf3a-6ee1-4793-98ce-ca38f537fe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:31Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Creating volume 2006cf3a-6ee1-4793-98ce-ca38f537fe9a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:32 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987f2ee5-96fc-4fe3-bfda-187ab1ab24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a 1073741824 Sep 23 00:36:32 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b313f2d1-4070-46e6-b0db-9020d9b1b82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b (fab07552-33c5-41e7-b6f9-2d7bdb4daf0b): created successfully Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b313f2d1-4070-46e6-b0db-9020d9b1b82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (6178566a-ebee-476f-97ca-e27e00d8857c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:32 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4d652acf-4aa6-497b-bf02-6cc1681bbf13 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created volume successfully. Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-520a1fae-df91-46aa-9802-718deaab804f-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Lock "cinder-520a1fae-df91-46aa-9802-718deaab804f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (bbdfdbbf-9c79-43c9-87e2-de7a29429ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7966d129-fb37-4314-999d-fd4d9291c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7966d129-fb37-4314-999d-fd4d9291c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098569767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd29b525-7e77-4a63-8f68-379a13fea4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:33Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22206eb4-b2ab-43bd-9e86-5f8216964e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22206eb4-b2ab-43bd-9e86-5f8216964e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2080c40c-3830-4780-977c-91fd3aaed346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2080c40c-3830-4780-977c-91fd3aaed346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd29b525-7e77-4a63-8f68-379a13fea4d3', 'volume_name': 'volume-cd29b525-7e77-4a63-8f68-379a13fea4d3', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7ce5c7-bf7a-47ff-aac2-9f2f6552f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7ce5c7-bf7a-47ff-aac2-9f2f6552f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbf380c-7b15-4667-99cd-1907bc54b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume cd29b525-7e77-4a63-8f68-379a13fea4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd29b525-7e77-4a63-8f68-379a13fea4d3', 'volume_size': 1} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-quobyte-520a1fae-df91-46aa-9802-718deaab804f" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-520a1fae-df91-46aa-9802-718deaab804f" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d6073e-d6de-480c-95d5-0468e320b4e1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a 1073741824" returned: 0 in 0.653s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a Sep 23 00:36:33 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f Sep 23 00:36:33 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (cd9523a3-cad1-4f39-a648-9113d7d43abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deaaa8f1-f09f-4243-850a-77f7dc8719cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deaaa8f1-f09f-4243-850a-77f7dc8719cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188757947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410d27f2-cacd-4bdc-a44a-b5bb894acbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:33Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adb32de-1ed2-4a6f-98b3-e0835f160ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adb32de-1ed2-4a6f-98b3-e0835f160ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a951197c-6da7-49d4-964e-b994d21e6713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a951197c-6da7-49d4-964e-b994d21e6713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410d27f2-cacd-4bdc-a44a-b5bb894acbce', 'volume_name': 'volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1162a5-ee28-40c7-937f-cf5fb3a3a174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1162a5-ee28-40c7-937f-cf5fb3a3a174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec61994-74ee-4ace-8b8f-3d7ff17b9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume 410d27f2-cacd-4bdc-a44a-b5bb894acbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce', 'volume_size': 1} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:33 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a" returned: 0 in 0.293s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.733s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating offline snapshot fa3591fc-f189-4fab-82da-66308bc88e10 of volume 156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc41b5-22c4-4886-8800-ea2a87f90e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e447fdff-61ae-494c-8b02-cf4ba4cb2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4227744-5222-41fa-8518-7ab4e824bd88]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a (2006cf3a-6ee1-4793-98ce-ca38f537fe9a): created successfully Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e447fdff-61ae-494c-8b02-cf4ba4cb2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (cb990caa-edfa-4549-95ae-f4d78128b4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-21f62570-6f14-4af5-b8ab-682c37fd2d34 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created volume successfully. Sep 23 00:36:33 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f" returned: 0 in 0.507s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f Sep 23 00:36:33 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 Sep 23 00:36:33 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-520a1fae-df91-46aa-9802-718deaab804f" returned: 0 in 0.276s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-520a1fae-df91-46aa-9802-718deaab804f" released by "delete_volume" :: held 0.849s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70" returned: 0 in 0.437s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Created reservations ['dffad843-3c11-4171-b072-aac592296cf6', '845a41e6-2cb8-498a-abeb-c16113956979', 'c032e499-5313-4f38-9c56-4b138946213f', 'ef5d1e0f-e3da-4271-b61b-0d25f185384d', 'c51e06b2-764e-46c9-9753-0d47b07a8910'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:33 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 1G Sep 23 00:36:33 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:34 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:34 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Deleted volume successfully. Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f3f07c70-ca41-4c1f-90e9-99576236791c tempest-ProjectReaderTests-1112016546 None] Lock "cinder-520a1fae-df91-46aa-9802-718deaab804f-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:34 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 1G" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 Sep 23 00:36:34 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10" returned: 0 in 0.309s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 is being set with open permissions: ugo+rw Sep 23 00:36:34 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 Sep 23 00:36:34 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info Sep 23 00:36:35 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info" returned: 0 in 0.288s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info is being set with open permissions: ugo+rw Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info Sep 23 00:36:35 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.info" returned: 0 in 0.290s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.407s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62145473-1205-4d06-9739-331bcd4a8876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:32Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Creating volume 62145473-1205-4d06-9739-331bcd4a8876 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:35 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 1073741824 Sep 23 00:36:35 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (f1bd5849-39ad-4c37-bc4d-63e0e9958321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24d9f65-19e9-47bf-98de-6987dcc997b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:35 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fbd33806-c9dd-4929-a722-c9c793d43c4b tempest-CreateVolumesFromSnapshotTest-1617256751 None] Create snapshot completed successfully Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24d9f65-19e9-47bf-98de-6987dcc997b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980553093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c232a86f-e417-42db-a17e-432ae4551a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:36Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e676214-3a0f-4c2e-9f30-5d961c9bc94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e676214-3a0f-4c2e-9f30-5d961c9bc94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db3eb56-ca4b-4ec4-b240-2d479891cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db3eb56-ca4b-4ec4-b240-2d479891cef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c232a86f-e417-42db-a17e-432ae4551a25', 'volume_name': 'volume-c232a86f-e417-42db-a17e-432ae4551a25', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d5ac92-b238-45d0-ad1d-30deccae48d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d5ac92-b238-45d0-ad1d-30deccae48d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9388ae-48a9-4a79-963e-76b42caf8e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:35 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Volume c232a86f-e417-42db-a17e-432ae4551a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c232a86f-e417-42db-a17e-432ae4551a25', 'volume_size': 1} Sep 23 00:36:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:36 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 1073741824" returned: 0 in 0.553s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 Sep 23 00:36:36 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:36 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (781802d8-54cc-4e1e-b34f-a594c3d4111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c61c8a7-e094-4223-9e13-ddf2dae9630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876" returned: 0 in 0.385s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.803s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098569767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd29b525-7e77-4a63-8f68-379a13fea4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:33Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Creating volume cd29b525-7e77-4a63-8f68-379a13fea4d3 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:36 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c61c8a7-e094-4223-9e13-ddf2dae9630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988862719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf1b893-8c2b-49bd-9ac0-6da5debe6dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:37Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423ba10a-9413-4f86-9313-ab28f0fde866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423ba10a-9413-4f86-9313-ab28f0fde866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 1073741824 Sep 23 00:36:36 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca56ef28-6d9f-4e05-af32-c2ed756c557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca56ef28-6d9f-4e05-af32-c2ed756c557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf1b893-8c2b-49bd-9ac0-6da5debe6dbd', 'volume_name': 'volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7364b5-bce4-46e0-baca-58f231946e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7364b5-bce4-46e0-baca-58f231946e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1ea45a-0efa-4fbe-b523-9bc6566ecd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume baf1b893-8c2b-49bd-9ac0-6da5debe6dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd', 'volume_size': 1} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537498f8-77c6-4f1b-8ac1-6de045b43f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62145473-1205-4d06-9739-331bcd4a8876', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7620c9c8-6a8f-4489-b39b-cd23a5c19edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume volume-62145473-1205-4d06-9739-331bcd4a8876 (62145473-1205-4d06-9739-331bcd4a8876): created successfully Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7620c9c8-6a8f-4489-b39b-cd23a5c19edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (999ca240-1127-4d4a-8e70-36003349b553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-26735715-5f93-468c-b151-e077df9834ab tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created volume successfully. Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (deb1c40e-1e60-4f10-96a6-8af07dda66e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcab050-c75e-46ef-b388-91910471c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcab050-c75e-46ef-b388-91910471c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1918165656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:37Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ee8a9f-096c-4f6d-9734-2f280736b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ee8a9f-096c-4f6d-9734-2f280736b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6dcf57-6c76-491e-93b2-7a88ee57d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6dcf57-6c76-491e-93b2-7a88ee57d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8', 'volume_name': 'volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2ae8f8-4c5c-440b-8293-fb5d0762fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2ae8f8-4c5c-440b-8293-fb5d0762fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a263263-b1c7-4b71-88f8-4d789333e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume 489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8', 'volume_size': 1} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:37 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 1073741824" returned: 0 in 0.640s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 Sep 23 00:36:37 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (dd8dd7ec-07d1-423a-9b2f-efe5c289b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71b41a4-88ea-4e8e-bebe-6f996c8c6639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71b41a4-88ea-4e8e-bebe-6f996c8c6639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048496975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fd15c7-43f4-4c21-8480-31092696f402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:37Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb3d392-d9b9-4264-bd87-b1261918a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb3d392-d9b9-4264-bd87-b1261918a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39723b57-7f80-4426-86f5-c1a8290d3945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39723b57-7f80-4426-86f5-c1a8290d3945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fd15c7-43f4-4c21-8480-31092696f402', 'volume_name': 'volume-18fd15c7-43f4-4c21-8480-31092696f402', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5dfaf4-fd3d-4b6a-b253-070b2c12fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5dfaf4-fd3d-4b6a-b253-070b2c12fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497632c6-42a2-49b4-a891-3656b12a885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume 18fd15c7-43f4-4c21-8480-31092696f402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fd15c7-43f4-4c21-8480-31092696f402', 'volume_size': 1} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:37 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.388s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188757947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410d27f2-cacd-4bdc-a44a-b5bb894acbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abae935a2214815bc270af7c027d225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:33Z,use_quota=True,user_id='5f67f7667fda4bbfaaa1e78b25c4e9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Creating volume 410d27f2-cacd-4bdc-a44a-b5bb894acbce {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:37 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce 1073741824 Sep 23 00:36:37 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbf380c-7b15-4667-99cd-1907bc54b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd29b525-7e77-4a63-8f68-379a13fea4d3', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea39f711-b5d0-4115-8141-d3f8281c7094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:37 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 (cd29b525-7e77-4a63-8f68-379a13fea4d3): created successfully Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea39f711-b5d0-4115-8141-d3f8281c7094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:37 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (bbdfdbbf-9c79-43c9-87e2-de7a29429ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:37 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1a4fc2df-06d9-4ceb-8f8a-64436b0f3cc4 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created volume successfully. Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (feaaa3a8-3bf5-4242-bfa0-392ed7984251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077132d-51ce-4bc7-8aaa-63e4f1f74905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077132d-51ce-4bc7-8aaa-63e4f1f74905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-536478889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0b9dc4-6a77-4814-bc81-70ef447c822d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:38Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b41e9d-d70a-4db5-a8ab-ae2be253fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b41e9d-d70a-4db5-a8ab-ae2be253fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416ad445-235e-4426-af8c-a43b216edb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416ad445-235e-4426-af8c-a43b216edb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0b9dc4-6a77-4814-bc81-70ef447c822d', 'volume_name': 'volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe9ad8b-65e4-4a72-9152-88e1037afa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe9ad8b-65e4-4a72-9152-88e1037afa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82dd95a-8c97-467f-8f65-3086ca12ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume 6a0b9dc4-6a77-4814-bc81-70ef447c822d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d', 'volume_size': 1} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:38 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce 1073741824" returned: 0 in 0.671s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:38 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce Sep 23 00:36:38 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (a60f45d0-dc6f-41f8-b4a5-16d4b1caac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397327b3-11ff-4f44-9f71-e1041fe703e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397327b3-11ff-4f44-9f71-e1041fe703e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775818341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba7fbd6-6a1c-49c1-91d3-27a682183a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:39Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d929969c-a61c-45a5-b32e-65e8947d849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d929969c-a61c-45a5-b32e-65e8947d849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ed10e6-17e9-4bc5-bc07-0acfbcdd58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ed10e6-17e9-4bc5-bc07-0acfbcdd58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba7fbd6-6a1c-49c1-91d3-27a682183a0e', 'volume_name': 'volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889724c1-d8e8-474e-a723-7d32b5fcc778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889724c1-d8e8-474e-a723-7d32b5fcc778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347efc73-78e3-4eb1-8bbc-4b963b02c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume fba7fbd6-6a1c-49c1-91d3-27a682183a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e', 'volume_size': 1} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:38 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce" returned: 0 in 0.316s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.961s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980553093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c232a86f-e417-42db-a17e-432ae4551a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:36Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Creating volume c232a86f-e417-42db-a17e-432ae4551a25 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:38 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:38 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 1073741824 Sep 23 00:36:38 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec61994-74ee-4ace-8b8f-3d7ff17b9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f6f663-705b-4a79-987d-5075bb78c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Volume volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce (410d27f2-cacd-4bdc-a44a-b5bb894acbce): created successfully Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f6f663-705b-4a79-987d-5075bb78c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Flow 'volume_create_manager' (cd9523a3-cad1-4f39-a648-9113d7d43abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-17bf2dc7-7652-44a0-8cb3-a6ddb6d9ca01 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created volume successfully. Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Flow 'volume_create_manager' (113a8232-d2fe-43c4-a2ab-2f86674b5c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba955e36-41bf-483e-9d92-11f4e57a2b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba955e36-41bf-483e-9d92-11f4e57a2b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0def02b-cbaa-4d1a-bb63-8271a6d809b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4155eae982e54783b42e7c3048293b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:39Z,use_quota=True,user_id='0939c139f16646f2a54a5ba50a772930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec11361-53d4-4e38-b436-72ac853c2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec11361-53d4-4e38-b436-72ac853c2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2f2fa1-f5a9-41e2-bc0d-c35357430a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.image.glance [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Creating Keystone auth plugin from conf {{(pid=87292) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2f2fa1-f5a9-41e2-bc0d-c35357430a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0def02b-cbaa-4d1a-bb63-8271a6d809b2', 'volume_name': 'volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2', 'volume_size': 1, 'image_id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b5ea44deeee6665a79c83ccb8cd258', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4155eae982e54783b42e7c3048293b9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de76c498044c203e6b5205e8b1a3bfdff1e2e405a503f9324f76856d1962e99f633924979094d68961837094ea663f9295c687850a97a19afef3c841f280edd1', 'id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c/file', 'properties': {}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e2760d-b723-4ba3-986d-2fee52d9a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e2760d-b723-4ba3-986d-2fee52d9a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fc612a-262f-4586-8ca1-fe765bc71ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Volume a0def02b-cbaa-4d1a-bb63-8271a6d809b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2', 'volume_size': 1, 'image_id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b5ea44deeee6665a79c83ccb8cd258', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4155eae982e54783b42e7c3048293b9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de76c498044c203e6b5205e8b1a3bfdff1e2e405a503f9324f76856d1962e99f633924979094d68961837094ea663f9295c687850a97a19afef3c841f280edd1', 'id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c/file', 'properties': {}}, 'image_service': } Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Trying to clone a0def02b-cbaa-4d1a-bb63-8271a6d809b2 from image f8c65715-3c99-4ee7-bce7-8c80fcfcac8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'metadata': {}}]). {{(pid=87292) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:36:39 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 1073741824" returned: 0 in 0.490s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:36:39 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:36:39 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 Sep 23 00:36:39 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfcbb2e-9e25-4ed9-b8cb-8efb51b82f54]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD Sep 23 00:36:39 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25" returned: 0 in 0.253s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.806s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988862719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf1b893-8c2b-49bd-9ac0-6da5debe6dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:37Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating volume baf1b893-8c2b-49bd-9ac0-6da5debe6dbd {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:39 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd 1073741824 Sep 23 00:36:39 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9388ae-48a9-4a79-963e-76b42caf8e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c232a86f-e417-42db-a17e-432ae4551a25', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a12fe0d-6ef7-48c8-ade2-7bf8ac8bb390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Volume volume-c232a86f-e417-42db-a17e-432ae4551a25 (c232a86f-e417-42db-a17e-432ae4551a25): created successfully Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a12fe0d-6ef7-48c8-ade2-7bf8ac8bb390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (f1bd5849-39ad-4c37-bc4d-63e0e9958321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8000a91d-fcb9-43cd-9dec-cce634398da0 tempest-ProjectReaderTests-1112016546 None] Created volume successfully. Sep 23 00:36:39 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD Sep 23 00:36:39 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-c232a86f-e417-42db-a17e-432ae4551a25-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-410d27f2-cacd-4bdc-a44a-b5bb894acbce-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-c232a86f-e417-42db-a17e-432ae4551a25-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-410d27f2-cacd-4bdc-a44a-b5bb894acbce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-quobyte-410d27f2-cacd-4bdc-a44a-b5bb894acbce" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-quobyte-c232a86f-e417-42db-a17e-432ae4551a25" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Temporary image f8c65715-3c99-4ee7-bce7-8c80fcfcac8c is fetched for user 0939c139f16646f2a54a5ba50a772930. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-410d27f2-cacd-4bdc-a44a-b5bb894acbce" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-c232a86f-e417-42db-a17e-432ae4551a25" acquired by "delete_volume" :: waited 0.037s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e57b36-adcb-4149-a6fd-9f8310bfbd76]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd 1073741824" returned: 0 in 0.644s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70a857c-12b0-4ca7-9f6a-cee91bc6e4b5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[47121927-b354-4774-9e4b-5722aa2276d9]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd Sep 23 00:36:40 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce Sep 23 00:36:40 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 Sep 23 00:36:40 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD Sep 23 00:36:40 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd" returned: 0 in 0.338s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.440s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1918165656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:37Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating volume 489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:40 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25" returned: 0 in 0.450s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 1073741824 Sep 23 00:36:40 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1ea45a-0efa-4fbe-b523-9bc6566ecd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46516e52-1207-4572-9442-7ae8ae11d30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:40 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25 Sep 23 00:36:40 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce" returned: 0 in 0.516s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd (baf1b893-8c2b-49bd-9ac0-6da5debe6dbd): created successfully Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46516e52-1207-4572-9442-7ae8ae11d30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (781802d8-54cc-4e1e-b34f-a594c3d4111a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:40 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce Sep 23 00:36:40 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0ff13153-2c68-459b-a0fe-200af7582d50 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created volume successfully. Sep 23 00:36:41 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD Sep 23 00:36:41 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c232a86f-e417-42db-a17e-432ae4551a25" returned: 0 in 0.424s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-c232a86f-e417-42db-a17e-432ae4551a25" released by "delete_volume" :: held 0.942s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:41 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-410d27f2-cacd-4bdc-a44a-b5bb894acbce" returned: 0 in 0.436s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-410d27f2-cacd-4bdc-a44a-b5bb894acbce" released by "delete_volume" :: held 1.019s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:41 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD" returned: 1 in 0.471s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Created reservations ['2ec346c3-a111-49ae-a84b-9a6be3b97691', '0ada9438-c151-422f-9744-01d584ca9bc2', '6d850657-6182-46ae-b18b-c1778191dc2b', '43dedb9e-7b03-4e20-b42b-a9fc3c67e57b', '982e0b1b-9680-4d33-a80a-47b4b3e0bde5'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:41 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 1073741824" returned: 0 in 0.619s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created reservations ['7686202b-c612-4ed9-a93e-04a1d4aadf1c', '7c5c75c5-dad9-44df-97d3-f898a3b44a88', '0f5e5b98-bcee-470d-9d1f-88f37864527c', '3560a7d0-2c63-44f1-9633-f6bdd28e49fc', '736e7329-d4d5-4b06-a25f-d6ec83929ed3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 Sep 23 00:36:41 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:41 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:41 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8" returned: 0 in 0.303s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.990s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048496975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fd15c7-43f4-4c21-8480-31092696f402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:37Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating volume 18fd15c7-43f4-4c21-8480-31092696f402 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:41 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.298s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a263263-b1c7-4b71-88f8-4d789333e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:41 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 1073741824 Sep 23 00:36:41 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8c52fc-43bb-49d2-9709-0b381c01e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Deleted volume successfully. Sep 23 00:36:41 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 (489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8): created successfully Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8c52fc-43bb-49d2-9709-0b381c01e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (deb1c40e-1e60-4f10-96a6-8af07dda66e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0ab8286-bc9e-440e-8f17-f5a89ff194c7 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-c232a86f-e417-42db-a17e-432ae4551a25-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:41 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.312s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6214a34f-1325-4dcf-a146-b16589342369 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created volume successfully. Sep 23 00:36:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Deleted volume successfully. Sep 23 00:36:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee74918e-a76b-4790-9330-995eb6940631 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-410d27f2-cacd-4bdc-a44a-b5bb894acbce-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:42 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 1073741824" returned: 0 in 0.465s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 Sep 23 00:36:42 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-cd29b525-7e77-4a63-8f68-379a13fea4d3-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-cd29b525-7e77-4a63-8f68-379a13fea4d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-quobyte-cd29b525-7e77-4a63-8f68-379a13fea4d3" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-cd29b525-7e77-4a63-8f68-379a13fea4d3" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:42 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402" returned: 0 in 0.307s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.354s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-536478889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0b9dc4-6a77-4814-bc81-70ef447c822d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:38Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating volume 6a0b9dc4-6a77-4814-bc81-70ef447c822d {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:42 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f09a61e-c2c0-42b8-8e61-332cb8848232]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d 1073741824 Sep 23 00:36:42 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497632c6-42a2-49b4-a891-3656b12a885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fd15c7-43f4-4c21-8480-31092696f402', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428d84cb-3309-4978-a2ac-ab562c3d464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume volume-18fd15c7-43f4-4c21-8480-31092696f402 (18fd15c7-43f4-4c21-8480-31092696f402): created successfully Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428d84cb-3309-4978-a2ac-ab562c3d464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (dd8dd7ec-07d1-423a-9b2f-efe5c289b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3df97776-3582-42ce-905b-89f9688bc740 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created volume successfully. Sep 23 00:36:42 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 Sep 23 00:36:42 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (2b7f0331-80d5-460b-bb4c-8adeca31b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab7ed14-9dc2-415f-b51c-48ddc8d33e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab7ed14-9dc2-415f-b51c-48ddc8d33e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77247487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a40b825-e076-42af-8d60-8eb5671884e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c636df2-103c-426e-a1b4-606b6392425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c636df2-103c-426e-a1b4-606b6392425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57307733-9a73-4fdf-a5f0-b7b99ba345a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57307733-9a73-4fdf-a5f0-b7b99ba345a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a40b825-e076-42af-8d60-8eb5671884e4', 'volume_name': 'volume-4a40b825-e076-42af-8d60-8eb5671884e4', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a053f8-1905-48a3-b9af-d9e477b0452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a053f8-1905-48a3-b9af-d9e477b0452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390065ec-993a-4835-8ebe-b881eec5c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Volume 4a40b825-e076-42af-8d60-8eb5671884e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a40b825-e076-42af-8d60-8eb5671884e4', 'volume_size': 1} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3" returned: 0 in 0.514s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3 Sep 23 00:36:43 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d 1073741824" returned: 0 in 0.560s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d Sep 23 00:36:43 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-cd29b525-7e77-4a63-8f68-379a13fea4d3" returned: 0 in 0.244s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-cd29b525-7e77-4a63-8f68-379a13fea4d3" released by "delete_volume" :: held 0.838s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:43 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d" returned: 0 in 0.259s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.741s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775818341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba7fbd6-6a1c-49c1-91d3-27a682183a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310c7e23574d44779469b029b9cd83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:39Z,use_quota=True,user_id='a85cda9bc19548fbbe7463eb4f429732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Creating volume fba7fbd6-6a1c-49c1-91d3-27a682183a0e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:43 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created reservations ['d3b00c87-f8d0-4736-965c-d5012a196e87', 'ccb9694a-8a51-4927-8fa7-2f4efabb2c4a', '34413a4c-32bb-4622-9bd1-491c67fd9a5a', '409b159e-d5bb-4641-b29a-9ac20211880a', 'a746e1a7-01f2-4cd2-bbb6-2a1dcf1ed3e8'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:43 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e 1073741824 Sep 23 00:36:43 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82dd95a-8c97-467f-8f65-3086ca12ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6666ae-55b3-4d04-91a4-321fc45e089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d (6a0b9dc4-6a77-4814-bc81-70ef447c822d): created successfully Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6666ae-55b3-4d04-91a4-321fc45e089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (feaaa3a8-3bf5-4242-bfa0-392ed7984251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d9be7751-cb05-4760-b81d-e186ac91d25a tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created volume successfully. Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:43 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.265s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Deleted volume successfully. Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5e2a11cc-69dc-49f1-9ec1-25d44ba8b81f tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-cd29b525-7e77-4a63-8f68-379a13fea4d3-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:43 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e 1073741824" returned: 0 in 0.486s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e Sep 23 00:36:44 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0def02b-cbaa-4d1a-bb63-8271a6d809b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4155eae982e54783b42e7c3048293b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:39Z,use_quota=True,user_id='0939c139f16646f2a54a5ba50a772930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Creating volume a0def02b-cbaa-4d1a-bb63-8271a6d809b2 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:44 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347efc73-78e3-4eb1-8bbc-4b963b02c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 1073741824 Sep 23 00:36:44 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1efa55-2723-4911-8dab-25a5a9f21540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Volume volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e (fba7fbd6-6a1c-49c1-91d3-27a682183a0e): created successfully Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1efa55-2723-4911-8dab-25a5a9f21540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Flow 'volume_create_manager' (a60f45d0-dc6f-41f8-b4a5-16d4b1caac4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-eb53de5e-bda3-4846-81cb-b929b8a1a9f4 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created volume successfully. Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-62145473-1205-4d06-9739-331bcd4a8876-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-62145473-1205-4d06-9739-331bcd4a8876-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:44 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 1073741824" returned: 0 in 0.480s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-quobyte-62145473-1205-4d06-9739-331bcd4a8876" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-62145473-1205-4d06-9739-331bcd4a8876" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[faec7028-0b48-455a-aaf4-d1600f52073e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 Sep 23 00:36:44 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 Sep 23 00:36:44 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" returned: 0 in 0.269s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77247487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a40b825-e076-42af-8d60-8eb5671884e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a43d458b30430daaceda9020de373c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='44c11e7ff53741edb379ad1520d96cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Creating volume 4a40b825-e076-42af-8d60-8eb5671884e4 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:45 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 1073741824 Sep 23 00:36:45 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Attempting download of f8c65715-3c99-4ee7-bce7-8c80fcfcac8c ((None, [{'url': 'file:///opt/stack/data/glance/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'metadata': {}}])) to volume a0def02b-cbaa-4d1a-bb63-8271a6d809b2. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a197fca5-cfe8-45bd-9e4a-e81afe20886f]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876" returned: 0 in 0.517s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-fba7fbd6-6a1c-49c1-91d3-27a682183a0e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:45 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876 Sep 23 00:36:45 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h Sep 23 00:36:45 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-fba7fbd6-6a1c-49c1-91d3-27a682183a0e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-fba7fbd6-6a1c-49c1-91d3-27a682183a0e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-fba7fbd6-6a1c-49c1-91d3-27a682183a0e" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9d417a-9ed8-437e-bb89-0acee997a577]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e Sep 23 00:36:45 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 1073741824" returned: 0 in 0.590s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-62145473-1205-4d06-9739-331bcd4a8876" returned: 0 in 0.358s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h" returned: 0 in 0.493s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-62145473-1205-4d06-9739-331bcd4a8876" released by "delete_volume" :: held 0.947s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 Sep 23 00:36:45 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created reservations ['d7915bb7-3c9b-49f7-b17c-7794010b700a', '6ad26fe8-93a0-401c-8376-66dffa871b21', 'cbcf0a85-08c9-4a0e-93a6-714a24e978ec', '4939f02c-918d-485c-994a-1cf5501de1a1', '7a362d8b-8e95-484f-aee5-fa5e6cb98ba5'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:45 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h Sep 23 00:36:45 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:45 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e" returned: 0 in 0.523s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e Sep 23 00:36:46 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h" returned: 1 in 0.394s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_yz6syb4h' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d42b66-d527-4983-99cd-7823c6784527]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4" returned: 0 in 0.400s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390065ec-993a-4835-8ebe-b881eec5c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a40b825-e076-42af-8d60-8eb5671884e4', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c27d09f-97f2-4805-9b77-68840c9fed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Volume volume-4a40b825-e076-42af-8d60-8eb5671884e4 (4a40b825-e076-42af-8d60-8eb5671884e4): created successfully Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c27d09f-97f2-4805-9b77-68840c9fed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Flow 'volume_create_manager' (2b7f0331-80d5-460b-bb4c-8adeca31b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d3c2f22e-4f5f-4d5d-9da5-338761b05e78 tempest-ProjectReaderTests-1112016546 None] Created volume successfully. Sep 23 00:36:46 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD Sep 23 00:36:46 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Deleted volume successfully. Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-39094e64-82ed-4e7f-ad0c-991a7af304ed tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-62145473-1205-4d06-9739-331bcd4a8876-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:46 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fba7fbd6-6a1c-49c1-91d3-27a682183a0e" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-fba7fbd6-6a1c-49c1-91d3-27a682183a0e" released by "delete_volume" :: held 0.905s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['555dd8c3-7819-4a03-8e35-03c5a4ab641e', '011e01c8-ae82-41ef-a221-9df1dc85c466', '0abddee7-2631-4f8b-9390-493f3a333cbf', 'b3e9405e-0e3d-4a58-b4ca-792ccf4495d7', '21f71c08-fb05-4e98-a0d3-859f3a2193cf'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:46 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:46 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD Sep 23 00:36:46 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.245s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleted volume successfully. Sep 23 00:36:46 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] f8c65715-3c99-4ee7-bce7-8c80fcfcac8c was raw, converting to qcow2 {{(pid=87292) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b496d164-964c-41ab-9a1c-cd1cc9ca29e1 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-fba7fbd6-6a1c-49c1-91d3-27a682183a0e-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:46 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 Sep 23 00:36:46 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-2006cf3a-6ee1-4793-98ce-ca38f537fe9a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-2006cf3a-6ee1-4793-98ce-ca38f537fe9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-quobyte-2006cf3a-6ee1-4793-98ce-ca38f537fe9a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-2006cf3a-6ee1-4793-98ce-ca38f537fe9a" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66faadc-2a8e-451d-b508-40723ba34dd3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a Sep 23 00:36:47 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-4a40b825-e076-42af-8d60-8eb5671884e4-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-4a40b825-e076-42af-8d60-8eb5671884e4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "cinder-quobyte-4a40b825-e076-42af-8d60-8eb5671884e4" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-4a40b825-e076-42af-8d60-8eb5671884e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d443e-3038-4804-bc98-bf69505360a3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" returned: 0 in 0.655s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8c65715-3c99-4ee7-bce7-8c80fcfcac8c_ttatedr4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:47 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 1G Sep 23 00:36:47 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a" returned: 0 in 0.494s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 Sep 23 00:36:47 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-6a0b9dc4-6a77-4814-bc81-70ef447c822d-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:47 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a Sep 23 00:36:47 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-6a0b9dc4-6a77-4814-bc81-70ef447c822d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-6a0b9dc4-6a77-4814-bc81-70ef447c822d" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-6a0b9dc4-6a77-4814-bc81-70ef447c822d" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2800761a-c1ef-414e-8d08-792e51245ca7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 1G" returned: 0 in 0.365s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Downloaded image f8c65715-3c99-4ee7-bce7-8c80fcfcac8c ((None, [{'url': 'file:///opt/stack/data/glance/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'metadata': {}}])) to volume a0def02b-cbaa-4d1a-bb63-8271a6d809b2 successfully. {{(pid=87292) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Temporary image f8c65715-3c99-4ee7-bce7-8c80fcfcac8c for user 0939c139f16646f2a54a5ba50a772930 is deleted. {{(pid=87292) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.volume.volume_utils [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Marking volume a0def02b-cbaa-4d1a-bb63-8271a6d809b2 as bootable. {{(pid=87292) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Copying metadata from image f8c65715-3c99-4ee7-bce7-8c80fcfcac8c to a0def02b-cbaa-4d1a-bb63-8271a6d809b2. {{(pid=87292) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Creating volume glance metadata for volume a0def02b-cbaa-4d1a-bb63-8271a6d809b2 backed by image f8c65715-3c99-4ee7-bce7-8c80fcfcac8c with: {'image_id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f4b5ea44deeee6665a79c83ccb8cd258', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87292) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:36:47 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fc612a-262f-4586-8ca1-fe765bc71ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2', 'volume_size': 1, 'image_id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b5ea44deeee6665a79c83ccb8cd258', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4155eae982e54783b42e7c3048293b9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de76c498044c203e6b5205e8b1a3bfdff1e2e405a503f9324f76856d1962e99f633924979094d68961837094ea663f9295c687850a97a19afef3c841f280edd1', 'id': 'f8c65715-3c99-4ee7-bce7-8c80fcfcac8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c65715-3c99-4ee7-bce7-8c80fcfcac8c/file', 'properties': {}}, 'image_service': }' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad67e06-9cf0-4eb4-b6f8-3e4256b2d8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:48 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d Sep 23 00:36:48 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4" returned: 0 in 0.533s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Volume volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 (a0def02b-cbaa-4d1a-bb63-8271a6d809b2): created successfully Sep 23 00:36:48 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4 Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad67e06-9cf0-4eb4-b6f8-3e4256b2d8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:48 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Flow 'volume_create_manager' (113a8232-d2fe-43c4-a2ab-2f86674b5c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-2006cf3a-6ee1-4793-98ce-ca38f537fe9a" returned: 0 in 0.445s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-2006cf3a-6ee1-4793-98ce-ca38f537fe9a" released by "delete_volume" :: held 1.005s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-500ea536-142e-47de-abbb-f25e67f87aaf tempest-VolumeImageDependencyTests-1744847070 None] Created volume successfully. Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created reservations ['dd73c89c-cd5f-4ed7-abdb-96c1e0e4db3e', '1b33ef5e-ec84-4db9-ac2f-63299887258c', 'bd0d33ab-9d80-44b4-9a6c-ec3785272223', '671a4ac7-ceb7-47a3-8327-1cc48dbf361b', 'c325cbac-1b36-4107-80b4-0f1e097d5eed'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:48 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4a40b825-e076-42af-8d60-8eb5671884e4" returned: 0 in 0.298s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-quobyte-4a40b825-e076-42af-8d60-8eb5671884e4" released by "delete_volume" :: held 0.882s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Created reservations ['608f33ac-dc70-4cf0-a1f0-2513cb6ce11d', '27e90c57-efaa-4107-8638-a9756450d316', 'aba71b05-e0bc-4e9a-ace9-fa229a6a985e', 'a635c1c3-2f85-4598-99b0-634f9d811308', '8f6ad7e3-66a5-4dc7-a2b8-adaaa62d316d'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:48 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d" returned: 0 in 0.570s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d Sep 23 00:36:48 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:48 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.356s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Deleted volume successfully. Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ddd25bd8-f9d4-48d2-bd5d-526e8dec735c tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-2006cf3a-6ee1-4793-98ce-ca38f537fe9a-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:48 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6a0b9dc4-6a77-4814-bc81-70ef447c822d" returned: 0 in 0.381s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-6a0b9dc4-6a77-4814-bc81-70ef447c822d" released by "delete_volume" :: held 1.007s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Acquiring lock "cinder-a0def02b-cbaa-4d1a-bb63-8271a6d809b2-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:48 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.327s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Lock "cinder-a0def02b-cbaa-4d1a-bb63-8271a6d809b2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Deleted volume successfully. Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-91d4c9e6-59ee-41b0-a1f2-e8ce78bcf084 tempest-ProjectReaderTests-1112016546 None] Lock "cinder-4a40b825-e076-42af-8d60-8eb5671884e4-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['cc095b68-2857-48e6-9cd8-d84fb4cf590a', '3ebba5fa-836e-4143-88e3-112cad965861', 'bf7d5ac9-9200-4d76-9ede-e2334bab610c', '1bd08ed5-9e6b-4092-82aa-8c8df293e48f', 'e79e5e5d-5e86-44a0-a300-b6b8cc71a07f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Acquiring lock "cinder-quobyte-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Lock "cinder-quobyte-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce34e61a-c4ed-4caf-a306-49f9c76a1358]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:49 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 Sep 23 00:36:49 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-quobyte-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c25078-9e00-4e9e-bfe6-41c73b47aad0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.370s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:49 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleted volume successfully. Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-7f0bf21a-5ceb-48fd-9bd5-91a05ff3cfce tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-6a0b9dc4-6a77-4814-bc81-70ef447c822d-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:49 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b Sep 23 00:36:49 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2 Sep 23 00:36:49 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" returned: 0 in 0.319s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b" returned: 0 in 0.497s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Lock "cinder-quobyte-a0def02b-cbaa-4d1a-bb63-8271a6d809b2" released by "delete_volume" :: held 0.930s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:49 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b Sep 23 00:36:49 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-18fd15c7-43f4-4c21-8480-31092696f402-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-18fd15c7-43f4-4c21-8480-31092696f402-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Created reservations ['ee6250ad-dd75-49a8-b88b-fdb77637eacd', '7fbdc1cf-2e0b-4842-a90d-d66a7f8cc8ea', 'c70d5a00-1635-4faf-bead-116a6af9acc2', '1cf34455-f689-4237-ae12-986bc65fef1b', '6034fd77-7421-4a58-a20b-d0bd6e9e227b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-18fd15c7-43f4-4c21-8480-31092696f402" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-18fd15c7-43f4-4c21-8480-31092696f402" acquired by "delete_volume" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252efc9-c21e-4770-b224-ab883195049a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:50 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b" returned: 0 in 0.388s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b" released by "delete_volume" :: held 0.964s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:50 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 Sep 23 00:36:50 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created reservations ['e6304331-912b-49e5-966e-b27dbc3092c0', 'd47ab26d-ff9d-4780-8dfd-79b469a45472', '155e1e38-2d45-420a-ad2c-3d7c81161647', '8c345896-9cab-4afd-8109-a663fe22cb0a', '9ff495af-22ca-4805-a645-61d551de707f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.332s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Deleted volume successfully. Sep 23 00:36:50 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:50 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-703e7e2d-4b9b-4bf8-819b-47f2575950ef tempest-VolumeImageDependencyTests-1744847070 None] Lock "cinder-a0def02b-cbaa-4d1a-bb63-8271a6d809b2-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:50 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402" returned: 0 in 0.507s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402 Sep 23 00:36:50 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Deleted volume successfully. Sep 23 00:36:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d0f7e891-15bf-468f-b515-b141742c2ae2 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-fab07552-33c5-41e7-b6f9-2d7bdb4daf0b-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-18fd15c7-43f4-4c21-8480-31092696f402" returned: 0 in 0.293s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-18fd15c7-43f4-4c21-8480-31092696f402" released by "delete_volume" :: held 0.861s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['46589f9f-1bb3-41f1-a76b-df5bc75ec288', 'c1df3742-4bfa-40b8-b359-67765dc7bbf5', '9aeb28e7-8f02-4513-b131-8404b42c4d14', '2c63c90c-9ea5-4953-a74c-0491b612fefd', 'fa4840b7-ac28-4515-935e-5996e9d90c23'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:51 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc779b2-9645-4d3b-896c-fd8b33da3aff]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 Sep 23 00:36:51 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:51 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.428s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleted volume successfully. Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d079bd04-fa3b-4880-af71-302d8d99e347 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-18fd15c7-43f4-4c21-8480-31092696f402-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "cinder-quobyte-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37252c69-c6e1-4cbc-b837-27bd1a86888a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8" returned: 0 in 0.570s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8 Sep 23 00:36:52 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 Sep 23 00:36:52 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8" returned: 0 in 0.364s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8" released by "delete_volume" :: held 1.011s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:52 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631" returned: 0 in 0.602s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631 Sep 23 00:36:52 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['595ce04c-6665-470b-8793-3ae9dd429988', '4cea5306-c308-41f5-a753-fc832a035855', 'c5fbd5c9-8978-458e-abb9-7694bff1791e', '03c6e458-dd49-484d-b038-b4771c67d824', '11113c25-1bf5-43c5-8ce3-db2fc2fb1532'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:52 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631" returned: 0 in 0.313s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-quobyte-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631" released by "delete_volume" :: held 0.993s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Created reservations ['0dd2146e-9bac-4e4f-88b6-e1e8a6b8c7de', '309c39f7-6da8-4201-ac41-8f93b8aa378b', '1df917bb-84d9-4737-9fbd-72c14c1d726e', '33ceab5c-11b7-4f0d-bff9-0d75d5f50140', '33b5942e-56b3-4004-ac55-300b2c8adfe8'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:53 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.402s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleted volume successfully. Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9a51d57f-31df-425b-9960-1aafd2684df0 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-489abfb9-8f0b-4fd8-9ab5-c5b7e786dac8-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:53 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:53 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Deleted volume successfully. Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=215,cinder:UPDATE=305,cinder:DELETE=35,cinder:INSERT=75 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a3d283e8-557e-474f-90a7-815d68ae7c51 tempest-CreateVolumesFromSourceVolumeTest-1800279539 None] Lock "cinder-de67f0a7-8338-4bbc-8c8c-2d5ce3ef6631-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0f0429-72b4-4916-921d-dc46b993402a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd Sep 23 00:36:53 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd Sep 23 00:36:54 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd" released by "delete_volume" :: held 0.940s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=285,cinder:SELECT=216,cinder:INSERT=91,cinder:DELETE=15 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['e41c70ab-ea6b-4e09-8d44-2af7aee63c14', '7e244f6f-7242-40d1-b15b-e43dd3004f24', 'a5645b5c-de9b-48cd-8d65-37350e1d3bae', 'bde2a119-1f54-40c6-b60c-11d9a1537fba', '70bbf585-d6ec-4c8f-a06f-a60625540551'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:54 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:55 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:36:55 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.314s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:55 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleted volume successfully. Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d4a4cd2c-0ae5-4c75-92d2-a5a62194c1cb tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-baf1b893-8c2b-49bd-9ac0-6da5debe6dbd-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.371s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:36:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-fa3591fc-f189-4fab-82da-66308bc88e10-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-fa3591fc-f189-4fab-82da-66308bc88e10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-156a11c5-4c7c-40a3-9170-f82cd473cd70" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-156a11c5-4c7c-40a3-9170-f82cd473cd70" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-fa3591fc-f189-4fab-82da-66308bc88e10" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-fa3591fc-f189-4fab-82da-66308bc88e10" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleting offline snapshot fa3591fc-f189-4fab-82da-66308bc88e10 of volume 156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] snapshot_file for this snap is: volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[716da1fb-6d2b-444e-b983-cb91e6b8d565]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 Sep 23 00:36:56 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-156a11c5-4c7c-40a3-9170-f82cd473cd70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e51460e-77c1-4ef8-a5e2-517d8d88583e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 Sep 23 00:36:56 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (d05c82bf-edd4-4e2e-9d41-82aa254118c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87782342-cf46-4141-875b-891d53aa9176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87782342-cf46-4141-875b-891d53aa9176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765847974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91e5aa3-190c-4770-b8b6-964a9ce0e592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:57Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:56 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c4a3e3-4bc4-4b50-8fd8-d206a1b40474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c4a3e3-4bc4-4b50-8fd8-d206a1b40474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d568617d-59e9-455e-93f6-a4c37bd73754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d568617d-59e9-455e-93f6-a4c37bd73754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b91e5aa3-190c-4770-b8b6-964a9ce0e592', 'volume_name': 'volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958219d2-bbda-4997-91f6-93e1f3a146c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958219d2-bbda-4997-91f6-93e1f3a146c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803d2f6c-556b-4ef2-9f59-f08e141a6de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:57 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Volume b91e5aa3-190c-4770-b8b6-964a9ce0e592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592', 'volume_size': 1} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765847974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91e5aa3-190c-4770-b8b6-964a9ce0e592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:57Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Creating volume b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:57 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 1073741824 Sep 23 00:36:57 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70" returned: 0 in 0.503s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 Sep 23 00:36:57 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 1073741824" returned: 0 in 0.625s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10" returned: 0 in 0.434s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10 Sep 23 00:36:57 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 Sep 23 00:36:57 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:58 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70.fa3591fc-f189-4fab-82da-66308bc88e10" returned: 0 in 0.379s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:58 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592" returned: 0 in 0.382s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-fa3591fc-f189-4fab-82da-66308bc88e10" released by "_delete_snapshot" :: held 2.026s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803d2f6c-556b-4ef2-9f59-f08e141a6de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4680545-fcea-4c0a-890d-44f5a8b3b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-156a11c5-4c7c-40a3-9170-f82cd473cd70" released by "delete_snapshot" :: held 2.065s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:58 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Volume volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 (b91e5aa3-190c-4770-b8b6-964a9ce0e592): created successfully Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4680545-fcea-4c0a-890d-44f5a8b3b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (d05c82bf-edd4-4e2e-9d41-82aa254118c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-01bd734c-6aa9-4b29-ab51-4f665cf1c585 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['65056348-61d4-4754-9ee2-04fe17a69b0a', 'adffb449-c549-4ca4-bcb9-19240e9bf334', '2734fabc-c429-4769-9df7-40750539aa8c', '6bcf69b0-4d76-462c-9ade-2d2d8ab1ec72', '9240ea1c-49ca-4582-8b0f-ffc3903c1182'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Delete snapshot completed successfully. Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4364bcd4-1fe8-4934-8a4a-818a7ad7f879 tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-fa3591fc-f189-4fab-82da-66308bc88e10-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Flow 'volume_create_manager' (e014edf7-2a29-47fc-82d7-3296751eb3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8442b3cb-5255-4910-aced-6d7fe6f38962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8442b3cb-5255-4910-aced-6d7fe6f38962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fec756-379b-40e3-9165-14f13bea80d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f3bc9556d4928ae62179bc096c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:59Z,use_quota=True,user_id='0a392e0d2b4449ebaa240e0a656fefd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb0bab0-b0ff-40aa-bc45-90be7c039f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb0bab0-b0ff-40aa-bc45-90be7c039f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac49f0fa-7823-45a9-8904-a0baa535447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac49f0fa-7823-45a9-8904-a0baa535447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fec756-379b-40e3-9165-14f13bea80d8', 'volume_name': 'volume-c4fec756-379b-40e3-9165-14f13bea80d8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdaf817c-6716-4c95-b9b0-385bb2904b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdaf817c-6716-4c95-b9b0-385bb2904b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2a60ea-8279-4fbb-85a6-4d86ef8b6cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Volume c4fec756-379b-40e3-9165-14f13bea80d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fec756-379b-40e3-9165-14f13bea80d8', 'volume_size': 1} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fec756-379b-40e3-9165-14f13bea80d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f3bc9556d4928ae62179bc096c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:59Z,use_quota=True,user_id='0a392e0d2b4449ebaa240e0a656fefd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Creating volume c4fec756-379b-40e3-9165-14f13bea80d8 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:58 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:36:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:58 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 1073741824 Sep 23 00:36:58 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-156a11c5-4c7c-40a3-9170-f82cd473cd70-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-156a11c5-4c7c-40a3-9170-f82cd473cd70-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "cinder-quobyte-156a11c5-4c7c-40a3-9170-f82cd473cd70" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-156a11c5-4c7c-40a3-9170-f82cd473cd70" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:59 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 1073741824" returned: 0 in 0.693s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e2b0b0-5fb3-4ea2-a067-58e72f67d134]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:59 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 Sep 23 00:36:59 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:59 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 Sep 23 00:36:59 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8" returned: 0 in 0.265s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.225s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2a60ea-8279-4fbb-85a6-4d86ef8b6cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fec756-379b-40e3-9165-14f13bea80d8', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcd7b18-4e9d-4aa7-87e1-8ff626035530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Creating offline snapshot d91ced79-58c9-4bf8-868e-3566cff64589 of volume b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:59 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Volume volume-c4fec756-379b-40e3-9165-14f13bea80d8 (c4fec756-379b-40e3-9165-14f13bea80d8): created successfully Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcd7b18-4e9d-4aa7-87e1-8ff626035530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Flow 'volume_create_manager' (e014edf7-2a29-47fc-82d7-3296751eb3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040d55a-9355-4119-9adc-5d850e230a70]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-cb0d6d99-0991-4438-8e58-29b0c9b9e703 tempest-CinderUnicodeTest-1147402408 None] Created volume successfully. Sep 23 00:37:00 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70" returned: 0 in 0.485s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70 Sep 23 00:37:00 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 Sep 23 00:37:00 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-156a11c5-4c7c-40a3-9170-f82cd473cd70" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-quobyte-156a11c5-4c7c-40a3-9170-f82cd473cd70" released by "delete_volume" :: held 0.862s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:00 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 1G Sep 23 00:37:00 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Created reservations ['eaeb00fe-57ff-4fa6-95dc-23f6b8be06b8', 'ad46891d-d4f1-4e3a-a95d-fc226b2b0a02', 'efcba219-f0e9-4821-a779-594ee288644a', '45d63932-2d32-41aa-a6df-01d490ceb473', 'f38c8a1a-dced-4d34-9ac3-a17cc504a0ae'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:00 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.363s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Deleted volume successfully. Sep 23 00:37:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68f6269-6a80-423b-8c70-cdc24dd20bef tempest-CreateVolumesFromSnapshotTest-1617256751 None] Lock "cinder-156a11c5-4c7c-40a3-9170-f82cd473cd70-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:01 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 1G" returned: 0 in 0.687s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:01 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 Sep 23 00:37:01 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:01 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589" returned: 0 in 0.494s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:01 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 is being set with open permissions: ugo+rw Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:01 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 Sep 23 00:37:01 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Flow 'volume_create_manager' (abaddcb4-87e7-4c7d-ad7d-a3ed16238092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cdb9c7-c297-45d8-91bf-36fddbef4d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cdb9c7-c297-45d8-91bf-36fddbef4d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-121755864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1fc3ef-4268-4a75-a979-552240af861a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f3bc9556d4928ae62179bc096c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:02Z,use_quota=True,user_id='0a392e0d2b4449ebaa240e0a656fefd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9989262d-6217-46f2-ba96-abecfa6aa211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9989262d-6217-46f2-ba96-abecfa6aa211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965ab639-b030-47cf-bafe-1af4ada2da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965ab639-b030-47cf-bafe-1af4ada2da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1fc3ef-4268-4a75-a979-552240af861a', 'volume_name': 'volume-fb1fc3ef-4268-4a75-a979-552240af861a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a650ae4a-405b-410a-b46b-8f026a40f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a650ae4a-405b-410a-b46b-8f026a40f9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e26395-ef38-41b3-8d67-9684f8cee014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Volume fb1fc3ef-4268-4a75-a979-552240af861a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1fc3ef-4268-4a75-a979-552240af861a', 'volume_size': 1} Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:01 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info Sep 23 00:37:02 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info" returned: 0 in 0.314s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info is being set with open permissions: ugo+rw Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info Sep 23 00:37:02 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.info" returned: 0 in 0.294s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-121755864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1fc3ef-4268-4a75-a979-552240af861a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f3bc9556d4928ae62179bc096c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:02Z,use_quota=True,user_id='0a392e0d2b4449ebaa240e0a656fefd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Creating volume fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:02 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a 1073741824 Sep 23 00:37:02 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d82fb2a6-7176-468a-80bf-53864cf2baf5 tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:37:03 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a 1073741824" returned: 0 in 0.585s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:03 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a Sep 23 00:37:03 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a" returned: 0 in 0.283s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e26395-ef38-41b3-8d67-9684f8cee014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1fc3ef-4268-4a75-a979-552240af861a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d9814-9414-4db0-b2c0-53d119f4c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Volume volume-fb1fc3ef-4268-4a75-a979-552240af861a (fb1fc3ef-4268-4a75-a979-552240af861a): created successfully Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d9814-9414-4db0-b2c0-53d119f4c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Flow 'volume_create_manager' (abaddcb4-87e7-4c7d-ad7d-a3ed16238092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f2b9bbea-4235-47ce-91b7-fcead0e6afdd tempest-CinderUnicodeTest-1147402408 None] Created volume successfully. Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-d91ced79-58c9-4bf8-868e-3566cff64589-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Lock "cinder-d91ced79-58c9-4bf8-868e-3566cff64589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-b91e5aa3-190c-4770-b8b6-964a9ce0e592" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-b91e5aa3-190c-4770-b8b6-964a9ce0e592" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-d91ced79-58c9-4bf8-868e-3566cff64589" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d91ced79-58c9-4bf8-868e-3566cff64589" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot d91ced79-58c9-4bf8-868e-3566cff64589 of volume b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[00911b65-87e7-44f5-9c5b-e5ce5a15fec9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 Sep 23 00:37:04 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Creating offline snapshot a18535cd-d663-4e1d-a1a4-76839f59a8d3 of volume fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b595b-c62f-49d4-ab6c-3a40b083489e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a Sep 23 00:37:04 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589" returned: 0 in 0.528s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9ae726-4d58-4638-8f12-c5c4a640b2be]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 Sep 23 00:37:04 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a" returned: 0 in 0.638s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 1G Sep 23 00:37:05 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592" returned: 0 in 0.562s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 Sep 23 00:37:05 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 1G" returned: 0 in 0.651s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb1fc3ef-4268-4a75-a979-552240af861a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb1fc3ef-4268-4a75-a979-552240af861a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 Sep 23 00:37:05 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589" returned: 0 in 0.535s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589 Sep 23 00:37:05 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb1fc3ef-4268-4a75-a979-552240af861a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3" returned: 0 in 0.364s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 is being set with open permissions: ugo+rw Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 Sep 23 00:37:06 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592.d91ced79-58c9-4bf8-868e-3566cff64589" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d91ced79-58c9-4bf8-868e-3566cff64589" released by "_delete_snapshot" :: held 2.211s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-b91e5aa3-190c-4770-b8b6-964a9ce0e592" released by "delete_snapshot" :: held 2.258s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Created reservations ['c9f3fede-3a4a-48ee-97e1-74a6dfbe6c8c', 'e70c78bf-db3e-48bf-a80d-ff5d0079b6fb', '60755bb8-be3d-4d4e-b65f-cfb64dc22384', '27f223ca-fdbb-42cd-8826-5185430f1cd6', 'd7da6176-a2da-4665-88d8-d16c6152110f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:06 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3" returned: 0 in 0.360s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-44df159a-e874-46c7-8298-23c0f3db830e tempest-ProjectMemberTests-292579576 None] Lock "cinder-d91ced79-58c9-4bf8-868e-3566cff64589-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:06 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info Sep 23 00:37:06 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info" returned: 0 in 0.308s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info is being set with open permissions: ugo+rw Sep 23 00:37:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info Sep 23 00:37:06 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.info" returned: 0 in 0.329s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:07 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4778f51e-6c86-4dbf-ade5-c3f7b1242b14 tempest-CinderUnicodeTest-1147402408 None] Create snapshot completed successfully Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-b91e5aa3-190c-4770-b8b6-964a9ce0e592-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-b91e5aa3-190c-4770-b8b6-964a9ce0e592-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-b91e5aa3-190c-4770-b8b6-964a9ce0e592" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-b91e5aa3-190c-4770-b8b6-964a9ce0e592" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[658948cd-3cf3-4132-875e-21714dbd9596]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-a18535cd-d663-4e1d-a1a4-76839f59a8d3-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 Sep 23 00:37:07 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-a18535cd-d663-4e1d-a1a4-76839f59a8d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-quobyte-fb1fc3ef-4268-4a75-a979-552240af861a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-fb1fc3ef-4268-4a75-a979-552240af861a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-quobyte-a18535cd-d663-4e1d-a1a4-76839f59a8d3" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-a18535cd-d663-4e1d-a1a4-76839f59a8d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Deleting offline snapshot a18535cd-d663-4e1d-a1a4-76839f59a8d3 of volume fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] snapshot_file for this snap is: volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[184889e5-81d0-481f-a0b7-f910b782072e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 Sep 23 00:37:07 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592" returned: 0 in 0.482s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592 Sep 23 00:37:07 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3" returned: 0 in 0.449s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb1fc3ef-4268-4a75-a979-552240af861a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[236acc8f-2a03-4b7e-a680-f30598f26568]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-b91e5aa3-190c-4770-b8b6-964a9ce0e592" returned: 0 in 0.316s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-b91e5aa3-190c-4770-b8b6-964a9ce0e592" released by "delete_volume" :: held 0.876s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Created reservations ['38efdcfa-5ce5-4d4c-a184-f7bb5b49df69', 'd6b045cd-3c8d-4807-a084-375d485ffed4', 'adfb7964-55dd-4a11-8797-ccc0560f34a8', '5b645455-eb2a-4abc-8634-826183b7c88e', '9b6ff736-6974-4629-81b7-2bb430d39a1b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:08 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a Sep 23 00:37:08 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:08 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a" returned: 0 in 0.444s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 Sep 23 00:37:08 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.331s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:37:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-bafc6e1e-82c8-4f50-bc6e-5320708159a1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-b91e5aa3-190c-4770-b8b6-964a9ce0e592-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (7f0e5356-72fa-40c0-9cd5-5839cbf176ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4fa155-d75a-4cfd-9067-a8ebd2e41db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:09 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4fa155-d75a-4cfd-9067-a8ebd2e41db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1411857172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e079ca7-e061-4b8e-a16c-062b1d0d808a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:09Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b2e63d-dd58-4eb5-a497-d47cc52cb33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b2e63d-dd58-4eb5-a497-d47cc52cb33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6572c3b-f478-4eff-952d-7ba404cd18af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6572c3b-f478-4eff-952d-7ba404cd18af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e079ca7-e061-4b8e-a16c-062b1d0d808a', 'volume_name': 'volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbac0e9-c2d3-412e-b7f5-3d4ce6fc4c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbac0e9-c2d3-412e-b7f5-3d4ce6fc4c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b24277-37af-45ed-9f81-65d7ea28e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:09 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Volume 7e079ca7-e061-4b8e-a16c-062b1d0d808a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a', 'volume_size': 1} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1411857172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e079ca7-e061-4b8e-a16c-062b1d0d808a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:09Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Creating volume 7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:09 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3" returned: 0 in 0.602s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a 1073741824 Sep 23 00:37:09 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3 Sep 23 00:37:09 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a.a18535cd-d663-4e1d-a1a4-76839f59a8d3" returned: 0 in 0.375s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-a18535cd-d663-4e1d-a1a4-76839f59a8d3" released by "_delete_snapshot" :: held 2.047s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-fb1fc3ef-4268-4a75-a979-552240af861a" released by "delete_snapshot" :: held 2.084s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Created reservations ['53e6cb6e-50b3-452b-a309-fe970925ce49', '06e77208-00ba-41c6-bcfe-b24c9aa6a304', '7c3e5d32-70ae-4588-a962-29cdb41e49a2', '19c33644-e797-49a5-a848-39fcbd244244', '90b72d75-65b3-4de6-a93e-0518537dbee0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_db.api [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 00:37:09 devstack cinder-volume[87292]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 00:37:09 devstack cinder-volume[87292]: FROM reservations Sep 23 00:37:09 devstack cinder-volume[87292]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s, %(uuid_1_5)s) FOR UPDATE] Sep 23 00:37:09 devstack cinder-volume[87292]: [parameters: {'uuid_1_1': '53e6cb6e-50b3-452b-a309-fe970925ce49', 'uuid_1_2': '06e77208-00ba-41c6-bcfe-b24c9aa6a304', 'uuid_1_3': '7c3e5d32-70ae-4588-a962-29cdb41e49a2', 'uuid_1_4': '19c33644-e797-49a5-a848-39fcbd244244', 'uuid_1_5': '90b72d75-65b3-4de6-a93e-0518537dbee0'}] Sep 23 00:37:09 devstack cinder-volume[87292]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87292) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_db.api [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87292) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 00:37:09 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a 1073741824" returned: 0 in 0.653s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a Sep 23 00:37:09 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a" returned: 0 in 0.303s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b24277-37af-45ed-9f81-65d7ea28e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3869ac-aa3b-4937-aff5-aec29bc7f028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:10 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Volume volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a (7e079ca7-e061-4b8e-a16c-062b1d0d808a): created successfully Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3869ac-aa3b-4937-aff5-aec29bc7f028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (7f0e5356-72fa-40c0-9cd5-5839cbf176ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-df45f804-e9a9-4ab6-b58f-7f5202327d49 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-fb1fc3ef-4268-4a75-a979-552240af861a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-fb1fc3ef-4268-4a75-a979-552240af861a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Delete snapshot completed successfully. Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-82684b9e-cb70-41cc-a625-239487093d91 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-a18535cd-d663-4e1d-a1a4-76839f59a8d3-delete_snapshot" released by "delete_snapshot" :: held 3.385s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-quobyte-fb1fc3ef-4268-4a75-a979-552240af861a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-fb1fc3ef-4268-4a75-a979-552240af861a" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[718d1e54-d721-4064-8d1c-9c574dabb0a7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:11 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a Sep 23 00:37:11 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Creating offline snapshot ffc74b06-dbe2-4276-bd6c-7313d93cd80a of volume 7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bacdda8-9f08-429f-b518-d1ed0064a974]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:11 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:11 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a Sep 23 00:37:11 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a" returned: 0 in 0.574s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:11 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a Sep 23 00:37:11 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a" returned: 0 in 0.604s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a 1G Sep 23 00:37:12 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-fb1fc3ef-4268-4a75-a979-552240af861a" returned: 0 in 0.498s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-fb1fc3ef-4268-4a75-a979-552240af861a" released by "delete_volume" :: held 1.203s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Created reservations ['597a2378-c80f-40c9-a062-c56205bbad24', 'fff76313-4c46-4d7a-8b60-ca467d727b38', '8e814c2c-8588-41a7-b56e-03e373fae95c', '43114f9b-f31a-42fc-987a-c7ae38bbd597', '294e589c-bde5-42ec-a085-23d217b9ff81'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:12 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a 1G" returned: 0 in 0.678s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a Sep 23 00:37:12 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.349s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Deleted volume successfully. Sep 23 00:37:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-76469d48-a0c4-4c1b-ba7d-94a26a39d5ef tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-fb1fc3ef-4268-4a75-a979-552240af861a-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:13 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a" returned: 0 in 0.482s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a is being set with open permissions: ugo+rw Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-c4fec756-379b-40e3-9165-14f13bea80d8-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:13 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a Sep 23 00:37:13 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-c4fec756-379b-40e3-9165-14f13bea80d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "cinder-quobyte-c4fec756-379b-40e3-9165-14f13bea80d8" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-c4fec756-379b-40e3-9165-14f13bea80d8" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[588586ed-e1d9-4cf3-81e2-c3c56ab36e76]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a" returned: 0 in 0.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 Sep 23 00:37:13 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info Sep 23 00:37:13 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8" returned: 0 in 0.551s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8 Sep 23 00:37:14 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:14 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info" returned: 0 in 0.522s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info is being set with open permissions: ugo+rw Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info Sep 23 00:37:14 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:14 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-c4fec756-379b-40e3-9165-14f13bea80d8" returned: 0 in 0.383s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-quobyte-c4fec756-379b-40e3-9165-14f13bea80d8" released by "delete_volume" :: held 1.023s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Created reservations ['77e00c82-21db-44ea-9bfd-0d481c65cf4d', 'c65fea7a-c69f-47ce-82be-0d43562fa3a0', '23e7db17-0b92-4bd8-974b-8b66d4616b46', '7961061f-1965-46ad-ade7-d89ce9bad9c8', '1cd69594-3e0b-4026-8270-ec5f643dd1f0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:14 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.info" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.255s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-77b81986-1265-4bdc-8b69-2a2ace12f69c tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:14 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:14 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Deleted volume successfully. Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8b7230a2-4292-489b-ab7e-605fb8d1fa55 tempest-CinderUnicodeTest-1147402408 None] Lock "cinder-c4fec756-379b-40e3-9165-14f13bea80d8-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-ffc74b06-dbe2-4276-bd6c-7313d93cd80a-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-ffc74b06-dbe2-4276-bd6c-7313d93cd80a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-7e079ca7-e061-4b8e-a16c-062b1d0d808a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-7e079ca7-e061-4b8e-a16c-062b1d0d808a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-ffc74b06-dbe2-4276-bd6c-7313d93cd80a" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-ffc74b06-dbe2-4276-bd6c-7313d93cd80a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot ffc74b06-dbe2-4276-bd6c-7313d93cd80a of volume 7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a08b07-8d01-4a43-b737-6e434e4b9cd1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:15 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a Sep 23 00:37:15 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:16 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a" returned: 0 in 0.423s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8690b6-c612-4cac-8a20-e7d46a7481fc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:16 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a Sep 23 00:37:16 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:16 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a" returned: 0 in 0.578s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:16 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a Sep 23 00:37:16 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:17 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a" returned: 0 in 0.512s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:17 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a Sep 23 00:37:17 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:17 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a.ffc74b06-dbe2-4276-bd6c-7313d93cd80a" returned: 0 in 0.347s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-ffc74b06-dbe2-4276-bd6c-7313d93cd80a" released by "_delete_snapshot" :: held 2.048s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-7e079ca7-e061-4b8e-a16c-062b1d0d808a" released by "delete_snapshot" :: held 2.079s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:17 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Created reservations ['10d41528-3e00-4b51-8666-be3c47c00ce5', 'cb874f8a-424f-4385-996a-b0419dff3530', 'fffd68fb-94ae-44d7-bbb9-a1077cd0168e', '1229bb20-02a3-4399-8c1d-c0db42655dd6', '943413c2-1b43-4ab6-a4d3-f99cd7448f2f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Flow 'volume_create_manager' (fdf22210-f5a4-4c50-a567-407eb36a1d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf6f97-6a69-4ab7-9e63-f0148af2c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf6f97-6a69-4ab7-9e63-f0148af2c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830415102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcc166d-d200-4f08-8eec-1c7797fa946b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1876cd5dadfc43ceb2fb8f381fbb9680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:18Z,use_quota=True,user_id='b8da0c080eb54b0aae2859a501972577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d59ac7-e137-4eb1-a1fd-216e2d1fa510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d59ac7-e137-4eb1-a1fd-216e2d1fa510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215ecdf1-aed5-45bd-bc48-affd91f86ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215ecdf1-aed5-45bd-bc48-affd91f86ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcc166d-d200-4f08-8eec-1c7797fa946b', 'volume_name': 'volume-edcc166d-d200-4f08-8eec-1c7797fa946b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79906fc-ff85-4a0c-a616-63c7a7adcad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79906fc-ff85-4a0c-a616-63c7a7adcad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95618d4-eb5e-4dba-82b6-ed72d52588b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Volume edcc166d-d200-4f08-8eec-1c7797fa946b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcc166d-d200-4f08-8eec-1c7797fa946b', 'volume_size': 1} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830415102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcc166d-d200-4f08-8eec-1c7797fa946b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1876cd5dadfc43ceb2fb8f381fbb9680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:18Z,use_quota=True,user_id='b8da0c080eb54b0aae2859a501972577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Creating volume edcc166d-d200-4f08-8eec-1c7797fa946b {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:18 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:37:18 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b 1073741824 Sep 23 00:37:18 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d5ecaf82-27e5-4dea-8323-d4d48e9819e9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-ffc74b06-dbe2-4276-bd6c-7313d93cd80a-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:18 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b 1073741824" returned: 0 in 0.524s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:18 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b Sep 23 00:37:18 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Flow 'volume_create_manager' (c0efc868-a320-4f15-845f-3ee65d462257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987cc1f1-d914-429c-805b-dcc2a1ab65a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987cc1f1-d914-429c-805b-dcc2a1ab65a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1957483992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a7874a428e4a2b8a97f42acf25fe4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:19Z,use_quota=True,user_id='d205ca34e2e84b0d8c233b24c2f52e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01705518-a964-4a01-bd2d-f1d719832553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01705518-a964-4a01-bd2d-f1d719832553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09f35a7-9f1e-4046-82d2-9e86c84b73bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09f35a7-9f1e-4046-82d2-9e86c84b73bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0', 'volume_name': 'volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860911fc-7957-42ab-879b-73eff57b1061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860911fc-7957-42ab-879b-73eff57b1061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be8fa74-361c-4e17-8853-8160fbc94d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Volume 9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0', 'volume_size': 1} Sep 23 00:37:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:19 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b" returned: 0 in 0.283s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.167s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1957483992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a7874a428e4a2b8a97f42acf25fe4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:19Z,use_quota=True,user_id='d205ca34e2e84b0d8c233b24c2f52e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Creating volume 9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:19 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95618d4-eb5e-4dba-82b6-ed72d52588b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcc166d-d200-4f08-8eec-1c7797fa946b', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f8b6e-45dc-4875-85f3-f305fff6c783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 1073741824 Sep 23 00:37:19 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-7e079ca7-e061-4b8e-a16c-062b1d0d808a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Volume volume-edcc166d-d200-4f08-8eec-1c7797fa946b (edcc166d-d200-4f08-8eec-1c7797fa946b): created successfully Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f8b6e-45dc-4875-85f3-f305fff6c783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Flow 'volume_create_manager' (fdf22210-f5a4-4c50-a567-407eb36a1d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Lock "cinder-7e079ca7-e061-4b8e-a16c-062b1d0d808a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8149206d-00f7-46f6-a3c0-f7947eebae5f tempest-ProjectReaderTests-1629652693 None] Created volume successfully. Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-7e079ca7-e061-4b8e-a16c-062b1d0d808a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-7e079ca7-e061-4b8e-a16c-062b1d0d808a" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93ed901-56de-4431-9b26-9ebcc5941fe8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:19 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a Sep 23 00:37:19 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:19 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 1073741824" returned: 0 in 0.537s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:19 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 Sep 23 00:37:19 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:19 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a" returned: 0 in 0.445s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:19 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a Sep 23 00:37:19 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:19 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be8fa74-361c-4e17-8853-8160fbc94d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eb5a61-84c9-4c4a-8f76-c79bd98f75fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Volume volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 (9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0): created successfully Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eb5a61-84c9-4c4a-8f76-c79bd98f75fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Flow 'volume_create_manager' (c0efc868-a320-4f15-845f-3ee65d462257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f4707cef-8bb0-4d29-8480-2a8319e8a0ca tempest-SnapshotDependencyTests-715448918 None] Created volume successfully. Sep 23 00:37:19 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-7e079ca7-e061-4b8e-a16c-062b1d0d808a" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-7e079ca7-e061-4b8e-a16c-062b1d0d808a" released by "delete_volume" :: held 0.801s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Created reservations ['728a4e5d-6880-4e33-ab9c-0f7a88d26e4d', '6cefdd75-ef59-46f5-91a7-a1ddeb0e5b83', '69b12f4a-a8bb-4291-924d-5fcf5a0ca6ed', '21a50f11-cf28-48cb-b3bc-ced81121bdb4', '2e1f02fc-6d68-4d67-b768-56472a46779a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:20 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:20 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Acquiring lock "cinder-edcc166d-d200-4f08-8eec-1c7797fa946b-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Lock "cinder-edcc166d-d200-4f08-8eec-1c7797fa946b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:20 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.313s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:20 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-6782084c-5243-4d03-b57b-4d11eb68fa33 tempest-ProjectMemberTests-292579576 None] Lock "cinder-7e079ca7-e061-4b8e-a16c-062b1d0d808a-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Acquiring lock "cinder-quobyte-edcc166d-d200-4f08-8eec-1c7797fa946b" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Lock "cinder-quobyte-edcc166d-d200-4f08-8eec-1c7797fa946b" acquired by "delete_volume" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[21394782-6f07-4247-bb81-629c0dcb89d7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:20 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b Sep 23 00:37:20 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:21 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:21 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b Sep 23 00:37:21 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (3fe27a8c-62c4-43e9-8385-8da46dde8b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999813d7-cfc6-4f47-8cdc-6866e967144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999813d7-cfc6-4f47-8cdc-6866e967144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054543123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ebc741-ea38-4782-b8a3-b87475fc8926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:21Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e845e07-0586-4244-a6c3-5f3c7b25cc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e845e07-0586-4244-a6c3-5f3c7b25cc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cb9151-eeb4-4d0a-a469-9d736861b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cb9151-eeb4-4d0a-a469-9d736861b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ebc741-ea38-4782-b8a3-b87475fc8926', 'volume_name': 'volume-e7ebc741-ea38-4782-b8a3-b87475fc8926', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad217ce6-c0bd-4ea8-a41f-23c41d03fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad217ce6-c0bd-4ea8-a41f-23c41d03fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b690ef-377b-40e5-9faa-b6ce6ca4bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:21 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Volume e7ebc741-ea38-4782-b8a3-b87475fc8926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ebc741-ea38-4782-b8a3-b87475fc8926', 'volume_size': 1} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054543123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ebc741-ea38-4782-b8a3-b87475fc8926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:21Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Creating volume e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:21 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:21 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 1073741824 Sep 23 00:37:21 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:21 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-edcc166d-d200-4f08-8eec-1c7797fa946b" returned: 0 in 0.341s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Lock "cinder-quobyte-edcc166d-d200-4f08-8eec-1c7797fa946b" released by "delete_volume" :: held 0.943s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Created reservations ['540b6f82-101c-4e23-a00d-9df2a3f83e89', '381e7acb-da71-4082-b418-413a14138e48', '036753a5-1401-4efe-a8b2-28de1c177d1e', '444f7a2f-6128-4d8a-b287-d565f45c4009', '9f559d87-ea59-4e19-858a-d083042e3525'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:21 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:21 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:21 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.287s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:21 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Deleted volume successfully. Sep 23 00:37:21 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 1073741824" returned: 0 in 0.585s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3c850134-3586-47bf-8987-f65cb80dca85 tempest-ProjectReaderTests-1629652693 None] Lock "cinder-edcc166d-d200-4f08-8eec-1c7797fa946b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 Sep 23 00:37:22 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:22 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926" returned: 0 in 0.337s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.941s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Creating offline snapshot c01c2248-b28f-40e0-a8fc-58eed51b05af of volume 9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b690ef-377b-40e5-9faa-b6ce6ca4bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ebc741-ea38-4782-b8a3-b87475fc8926', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea20a76-87ae-48d7-9a47-c7ca5e2f3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cec52dd-b90c-478f-a64f-a1226106abf8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Volume volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 (e7ebc741-ea38-4782-b8a3-b87475fc8926): created successfully Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea20a76-87ae-48d7-9a47-c7ca5e2f3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (3fe27a8c-62c4-43e9-8385-8da46dde8b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Flow 'volume_create_manager' (299c315c-59ab-430f-b39d-21604129daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02390bdb-52d6-4d9f-89ea-4a6fdbb8b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-71cfeb2c-65ad-414e-91eb-8d16ea329a31 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02390bdb-52d6-4d9f-89ea-4a6fdbb8b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501811157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4437b104-eac8-48ee-9f6b-b947985710ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1876cd5dadfc43ceb2fb8f381fbb9680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:22Z,use_quota=True,user_id='b8da0c080eb54b0aae2859a501972577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b136b42-de49-480d-9b14-8e888d18e4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b136b42-de49-480d-9b14-8e888d18e4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84c54b8-9bf8-48b9-a1b8-fc208e5c1bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84c54b8-9bf8-48b9-a1b8-fc208e5c1bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4437b104-eac8-48ee-9f6b-b947985710ad', 'volume_name': 'volume-4437b104-eac8-48ee-9f6b-b947985710ad', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e317ba5-2d80-41cb-997a-39c20441c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e317ba5-2d80-41cb-997a-39c20441c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f9cd10-b6f2-41f2-b2b7-9f2b39154696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Volume 4437b104-eac8-48ee-9f6b-b947985710ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4437b104-eac8-48ee-9f6b-b947985710ad', 'volume_size': 1} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:22 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 Sep 23 00:37:22 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:22 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" returned: 0 in 0.435s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af 1G Sep 23 00:37:22 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:23 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af 1G" returned: 0 in 0.557s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:23 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af Sep 23 00:37:23 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:23 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:23 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af is being set with open permissions: ugo+rw Sep 23 00:37:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:23 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af Sep 23 00:37:23 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:23 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af" returned: 0 in 0.247s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info Sep 23 00:37:24 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info" returned: 0 in 0.277s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info is being set with open permissions: ugo+rw Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info Sep 23 00:37:24 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.info" returned: 0 in 0.286s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.070s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501811157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4437b104-eac8-48ee-9f6b-b947985710ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1876cd5dadfc43ceb2fb8f381fbb9680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:22Z,use_quota=True,user_id='b8da0c080eb54b0aae2859a501972577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Creating volume 4437b104-eac8-48ee-9f6b-b947985710ad {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:24 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad 1073741824 Sep 23 00:37:24 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-42eb21b7-bb6d-40e5-9f9a-599f08763a4e tempest-SnapshotDependencyTests-715448918 None] Create snapshot completed successfully Sep 23 00:37:25 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad 1073741824" returned: 0 in 0.532s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:25 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad Sep 23 00:37:25 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (fc930a0e-19bc-40b4-865b-ac17aca6844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030f9194-97b0-4e46-8768-120a444077c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad" returned: 0 in 0.267s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.015s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030f9194-97b0-4e46-8768-120a444077c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833593998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f792101-9580-4320-a1bc-04fedcfb9572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:25Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96a5709-1d36-4492-84f6-285e570e1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96a5709-1d36-4492-84f6-285e570e1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d433c7b-7b6e-45d7-9c60-16df3c28ff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d433c7b-7b6e-45d7-9c60-16df3c28ff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f792101-9580-4320-a1bc-04fedcfb9572', 'volume_name': 'volume-6f792101-9580-4320-a1bc-04fedcfb9572', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065fe5bc-6d4e-4c34-98bf-f991d3c3ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065fe5bc-6d4e-4c34-98bf-f991d3c3ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bef9909-32e5-45ce-8aaa-7cc305220e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Volume 6f792101-9580-4320-a1bc-04fedcfb9572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f792101-9580-4320-a1bc-04fedcfb9572', 'volume_size': 1} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f9cd10-b6f2-41f2-b2b7-9f2b39154696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4437b104-eac8-48ee-9f6b-b947985710ad', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6e4008-9279-46c1-95b9-f8102fca9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Creating offline snapshot 15d22bf0-ee44-477e-a0e9-43696c1672e5 of volume e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:25 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Volume volume-4437b104-eac8-48ee-9f6b-b947985710ad (4437b104-eac8-48ee-9f6b-b947985710ad): created successfully Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6e4008-9279-46c1-95b9-f8102fca9610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Flow 'volume_create_manager' (299c315c-59ab-430f-b39d-21604129daac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15ca10a-75c2-4f2c-83be-7113bb34ea5d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:25 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b27258bc-e11a-4cbf-8e7b-71decce54079 tempest-ProjectReaderTests-1629652693 None] Created volume successfully. Sep 23 00:37:25 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 Sep 23 00:37:25 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:25 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926" returned: 0 in 0.388s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 1G Sep 23 00:37:26 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Flow 'volume_create_manager' (ffde2148-710e-4818-9adc-b99211e87765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40f51d8-c317-41e1-b3d3-69e9536443e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40f51d8-c317-41e1-b3d3-69e9536443e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe7eb4f-d40d-4aa6-9ae5-91c01f809553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a7874a428e4a2b8a97f42acf25fe4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c01c2248-b28f-40e0-a8fc-58eed51b05af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:26Z,use_quota=True,user_id='d205ca34e2e84b0d8c233b24c2f52e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc1e80e-dbba-473c-ae9f-79c8a3486f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc1e80e-dbba-473c-ae9f-79c8a3486f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dca7a62-049d-45aa-bfb6-da9d967a7b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dca7a62-049d-45aa-bfb6-da9d967a7b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfe7eb4f-d40d-4aa6-9ae5-91c01f809553', 'volume_name': 'volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553', 'volume_size': 1, 'snapshot_id': 'c01c2248-b28f-40e0-a8fc-58eed51b05af'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e56197-46be-418b-ab4c-bb7604959d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e56197-46be-418b-ab4c-bb7604959d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e704fecc-0987-487b-baad-6794e1df6414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:26 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Volume bfe7eb4f-d40d-4aa6-9ae5-91c01f809553: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553', 'volume_size': 1, 'snapshot_id': 'c01c2248-b28f-40e0-a8fc-58eed51b05af'} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:26 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 1G" returned: 0 in 0.466s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 Sep 23 00:37:26 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Acquiring lock "cinder-4437b104-eac8-48ee-9f6b-b947985710ad-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Lock "cinder-4437b104-eac8-48ee-9f6b-b947985710ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Acquiring lock "cinder-quobyte-4437b104-eac8-48ee-9f6b-b947985710ad" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Lock "cinder-quobyte-4437b104-eac8-48ee-9f6b-b947985710ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd85d4a-09f8-4188-9e00-915563a6ec9a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5" returned: 0 in 0.340s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 is being set with open permissions: ugo+rw Sep 23 00:37:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 Sep 23 00:37:26 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad Sep 23 00:37:26 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5" returned: 0 in 0.251s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info Sep 23 00:37:27 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad" returned: 0 in 0.385s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad Sep 23 00:37:27 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info" returned: 0 in 0.258s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info is being set with open permissions: ugo+rw Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info Sep 23 00:37:27 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-4437b104-eac8-48ee-9f6b-b947985710ad" returned: 0 in 0.257s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Lock "cinder-quobyte-4437b104-eac8-48ee-9f6b-b947985710ad" released by "delete_volume" :: held 0.688s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Created reservations ['a9457d1f-dcd0-4a77-94ce-e017d6e70e71', '73cb0a57-6916-480b-ac59-8f3d87efb66f', 'a8db3bed-5078-45ac-afff-9d650a257736', '25370c7a-13cf-4628-9518-e2203b5978c6', '4de29f8b-79fd-4468-b474-f6911a81139b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.info" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:27 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833593998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f792101-9580-4320-a1bc-04fedcfb9572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:25Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Creating volume 6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:27 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 1073741824 Sep 23 00:37:27 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6bd536a1-0be5-443e-a880-d41012dc2af9 tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:37:27 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.268s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Deleted volume successfully. Sep 23 00:37:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-55276f26-7bb7-4b05-ba0b-f2037edf90ab tempest-ProjectReaderTests-1629652693 None] Lock "cinder-4437b104-eac8-48ee-9f6b-b947985710ad-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:28 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 1073741824" returned: 0 in 0.477s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 Sep 23 00:37:28 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:28 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572" returned: 0 in 0.279s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.076s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-quobyte-c01c2248-b28f-40e0-a8fc-58eed51b05af-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" by "_create_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bef9909-32e5-45ce-8aaa-7cc305220e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f792101-9580-4320-a1bc-04fedcfb9572', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741c0fde-5f62-47b8-8811-e6b1b1b06bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-c01c2248-b28f-40e0-a8fc-58eed51b05af-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Creating volume bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 from snapshot c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-quobyte-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" by "_copy_volume_from_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Volume volume-6f792101-9580-4320-a1bc-04fedcfb9572 (6f792101-9580-4320-a1bc-04fedcfb9572): created successfully Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741c0fde-5f62-47b8-8811-e6b1b1b06bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (fc930a0e-19bc-40b4-865b-ac17aca6844e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] snapshot: c01c2248-b28f-40e0-a8fc-58eed51b05af, volume: bfe7eb4f-d40d-4aa6-9ae5-91c01f809553, {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:28 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-6641dce0-046d-494f-ba14-21cf73cc239f tempest-ProjectReaderTests-1092376017 None] Created volume successfully. Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba38b98-99f8-44f8-bcfd-d3f6844a9828]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-15d22bf0-ee44-477e-a0e9-43696c1672e5-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af Sep 23 00:37:28 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-15d22bf0-ee44-477e-a0e9-43696c1672e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-e7ebc741-ea38-4782-b8a3-b87475fc8926" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-e7ebc741-ea38-4782-b8a3-b87475fc8926" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-15d22bf0-ee44-477e-a0e9-43696c1672e5" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-15d22bf0-ee44-477e-a0e9-43696c1672e5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot 15d22bf0-ee44-477e-a0e9-43696c1672e5 of volume e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f7e26b-7715-4dfd-aa4d-f71ce70a1111]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 Sep 23 00:37:28 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af" returned: 0 in 0.448s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dabcae-75f5-4161-923c-65481e03e026]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 Sep 23 00:37:29 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5" returned: 0 in 0.423s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7ebc741-ea38-4782-b8a3-b87475fc8926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[014cb341-230a-4c3f-87f2-ece40a6cf425]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 Sep 23 00:37:29 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" returned: 0 in 0.416s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Creating direct copy from snapshot {{(pid=87292) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG cinder.utils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Path /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 not found in is_blk_device check {{(pid=87292) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 Sep 23 00:37:29 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926" returned: 0 in 0.518s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 Sep 23 00:37:29 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:30 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5" returned: 0 in 0.526s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5 Sep 23 00:37:30 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:30 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926.15d22bf0-ee44-477e-a0e9-43696c1672e5" returned: 0 in 0.372s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-15d22bf0-ee44-477e-a0e9-43696c1672e5" released by "_delete_snapshot" :: held 2.006s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-e7ebc741-ea38-4782-b8a3-b87475fc8926" released by "delete_snapshot" :: held 2.042s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:30 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Created reservations ['754ab9e4-9add-483b-8aeb-ef5081146e6a', '878d98de-6aa6-4643-93e8-bf30645110fd', '7a29508e-cb79-4eca-8233-709a48605fa9', 'c5250952-d540-4538-92df-9ac432b6ca40', '5f72e007-578e-49ce-9de2-f4b74f9194dd'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:31 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:37:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c72de373-3d5a-4e12-927f-0278577341f9 tempest-ProjectMemberTests-292579576 None] Lock "cinder-15d22bf0-ee44-477e-a0e9-43696c1672e5-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:31 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-e7ebc741-ea38-4782-b8a3-b87475fc8926-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Lock "cinder-e7ebc741-ea38-4782-b8a3-b87475fc8926-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-e7ebc741-ea38-4782-b8a3-b87475fc8926" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-e7ebc741-ea38-4782-b8a3-b87475fc8926" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f7c1c-f4a5-4941-be2f-d0f8b9be7659]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:32 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 Sep 23 00:37:32 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:32 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926" returned: 0 in 0.496s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:32 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:32 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926 Sep 23 00:37:32 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:33 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-e7ebc741-ea38-4782-b8a3-b87475fc8926" returned: 0 in 0.317s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-e7ebc741-ea38-4782-b8a3-b87475fc8926" released by "delete_volume" :: held 0.937s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Created reservations ['5f54f178-a071-4405-b1cd-1185ddf06f64', '250b75ef-56fa-4611-a299-c18785758938', '4dc210e9-0a90-4cff-bcdf-1943397f84d3', '18c09461-af3e-4fea-a074-9c7f27a96e74', '7c950d91-99b6-4385-88ee-34b8dce511f3'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:33 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:33 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:33 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:33 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:37:33 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-53fcb51d-e470-43e5-81ef-8792b9404cd6 tempest-ProjectMemberTests-292579576 None] Lock "cinder-e7ebc741-ea38-4782-b8a3-b87475fc8926-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (d73930fd-1221-4b19-9125-4cd4704ebfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf9b00-da68-41c5-a312-089bb7833420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf9b00-da68-41c5-a312-089bb7833420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648757227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cb1227-6f2c-4547-ab44-53cb12d32473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:35Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96be71aa-31b6-4e2b-9316-211f385de396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96be71aa-31b6-4e2b-9316-211f385de396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632084a4-85ca-458a-b86a-8b891d16cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632084a4-85ca-458a-b86a-8b891d16cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9cb1227-6f2c-4547-ab44-53cb12d32473', 'volume_name': 'volume-f9cb1227-6f2c-4547-ab44-53cb12d32473', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb99df5-0b27-4f54-ab5b-f897b62b15df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb99df5-0b27-4f54-ab5b-f897b62b15df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3d3c91-49ce-49d7-88c0-b1c4430fe333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:35 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Volume f9cb1227-6f2c-4547-ab44-53cb12d32473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9cb1227-6f2c-4547-ab44-53cb12d32473', 'volume_size': 1} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:35 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" returned: 0 in 6.379s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG cinder.image.image_utils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Image conversion details: src /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 {{(pid=87292) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:37:35 devstack cinder-volume[87292]: INFO cinder.image.image_utils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Converted 1024.00 MB image at 160.51 MB/s Sep 23 00:37:35 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 is being set with open permissions: ugo+rw Sep 23 00:37:35 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:35 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 Sep 23 00:37:35 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:36 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" returned: 0 in 0.257s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" released by "_copy_volume_from_snapshot" :: held 7.611s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-c01c2248-b28f-40e0-a8fc-58eed51b05af-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" released by "_create_volume_from_snapshot" :: held 7.695s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.731s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.219s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Creating offline snapshot 056bb65b-2062-4f71-b070-2171a7575e5e of volume 6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e704fecc-0987-487b-baad-6794e1df6414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553', 'volume_size': 1, 'snapshot_id': 'c01c2248-b28f-40e0-a8fc-58eed51b05af'}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bb286c-e3af-4914-a7c2-f736f939085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc490f-8207-4b3e-9047-37c0b7ea203b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:36 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Volume volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 (bfe7eb4f-d40d-4aa6-9ae5-91c01f809553): created successfully Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bb286c-e3af-4914-a7c2-f736f939085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Flow 'volume_create_manager' (ffde2148-710e-4818-9adc-b99211e87765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:36 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5953fc93-3398-43cd-9879-3e30445499d3 tempest-SnapshotDependencyTests-715448918 None] Created volume successfully. Sep 23 00:37:36 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 Sep 23 00:37:36 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:36 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572" returned: 0 in 0.369s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:36 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:36 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e 1G Sep 23 00:37:36 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e 1G" returned: 0 in 0.425s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f792101-9580-4320-a1bc-04fedcfb9572 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f792101-9580-4320-a1bc-04fedcfb9572 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e Sep 23 00:37:37 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-c01c2248-b28f-40e0-a8fc-58eed51b05af-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-c01c2248-b28f-40e0-a8fc-58eed51b05af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-quobyte-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-quobyte-c01c2248-b28f-40e0-a8fc-58eed51b05af" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-c01c2248-b28f-40e0-a8fc-58eed51b05af" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Deleting offline snapshot c01c2248-b28f-40e0-a8fc-58eed51b05af of volume 9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] snapshot_file for this snap is: volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a856a-d7f5-4e82-8432-d6d8cea09f0f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af Sep 23 00:37:37 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f792101-9580-4320-a1bc-04fedcfb9572 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e" returned: 0 in 0.294s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e is being set with open permissions: ugo+rw Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e Sep 23 00:37:37 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e" returned: 0 in 0.241s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af" returned: 0 in 0.415s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:37 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info Sep 23 00:37:37 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[95152555-9c72-4873-9dc6-22d8b1a3dce8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 Sep 23 00:37:37 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info" returned: 0 in 0.245s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info is being set with open permissions: ugo+rw Sep 23 00:37:37 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info Sep 23 00:37:37 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.info" returned: 0 in 0.250s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648757227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cb1227-6f2c-4547-ab44-53cb12d32473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:35Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Creating volume f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:38 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:38 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 1073741824 Sep 23 00:37:38 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a1bf90f5-aeb3-43d6-b558-b055742ce480 tempest-ProjectReaderTests-1092376017 None] Create snapshot completed successfully Sep 23 00:37:38 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" returned: 0 in 0.598s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:38 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af Sep 23 00:37:38 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 1073741824" returned: 0 in 0.452s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af" returned: 0 in 0.382s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:38 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af Sep 23 00:37:38 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 Sep 23 00:37:38 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-056bb65b-2062-4f71-b070-2171a7575e5e-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-056bb65b-2062-4f71-b070-2171a7575e5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-6f792101-9580-4320-a1bc-04fedcfb9572" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-6f792101-9580-4320-a1bc-04fedcfb9572" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-056bb65b-2062-4f71-b070-2171a7575e5e" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-056bb65b-2062-4f71-b070-2171a7575e5e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Deleting offline snapshot 056bb65b-2062-4f71-b070-2171a7575e5e of volume 6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] snapshot_file for this snap is: volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[05592ce6-e335-4217-a2c8-a3e5538e4837]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:38 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0.c01c2248-b28f-40e0-a8fc-58eed51b05af" returned: 0 in 0.272s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e Sep 23 00:37:38 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473" returned: 0 in 0.293s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-c01c2248-b28f-40e0-a8fc-58eed51b05af" released by "_delete_snapshot" :: held 1.773s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3d3c91-49ce-49d7-88c0-b1c4430fe333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cb1227-6f2c-4547-ab44-53cb12d32473', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a359728c-0a66-41d8-8ab9-ea34c365be97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" released by "delete_snapshot" :: held 1.816s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:38 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Volume volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 (f9cb1227-6f2c-4547-ab44-53cb12d32473): created successfully Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a359728c-0a66-41d8-8ab9-ea34c365be97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:38 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (d73930fd-1221-4b19-9125-4cd4704ebfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5ad20ef3-9b5c-4b8a-8b4d-5872e3a7bff8 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Created reservations ['5f69f141-8d44-4472-9557-78c0087cf2e6', '408b6c00-4842-4ab5-b5e4-665137e2ac2b', '14928667-5308-4357-bd03-feebde49cffb', '6d9cce4c-b217-4a9c-bf47-e95e06218ddd', '88ca2691-dfd9-42c1-9a36-e96b94791e02'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:39 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Delete snapshot completed successfully. Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-141de03d-ac64-458b-ae9c-8df232825fb7 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-c01c2248-b28f-40e0-a8fc-58eed51b05af-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:39 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e" returned: 0 in 0.369s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f792101-9580-4320-a1bc-04fedcfb9572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df73c06-1ef8-4007-a750-19f77ed09996]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:39 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 Sep 23 00:37:39 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-quobyte-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d63329-2508-4ba3-9050-1545c1baf31b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Creating offline snapshot 2c405c99-78d5-4367-a933-fba859b5502b of volume f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d92a90-2745-415a-a7e7-787853572baf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 Sep 23 00:37:39 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572" returned: 0 in 0.399s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e Sep 23 00:37:39 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 Sep 23 00:37:39 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" returned: 0 in 0.411s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0 Sep 23 00:37:39 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473" returned: 0 in 0.373s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e" returned: 0 in 0.358s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b 1G Sep 23 00:37:39 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e Sep 23 00:37:39 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" returned: 0 in 0.267s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0" released by "delete_volume" :: held 0.754s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Created reservations ['be39c9aa-4226-4729-a1f7-00d83af7bfc7', '830e3ea1-9580-422c-a27b-f3c7e443828d', 'e0fc4527-6d37-496d-8356-bbfbc8ea8693', 'aa0858be-5dbe-4c48-a72d-a0e0d227a3a8', 'ef4bcef7-ca06-44e2-aa6a-8147487abd8b'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:40 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572.056bb65b-2062-4f71-b070-2171a7575e5e" returned: 0 in 0.262s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-056bb65b-2062-4f71-b070-2171a7575e5e" released by "_delete_snapshot" :: held 1.498s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-6f792101-9580-4320-a1bc-04fedcfb9572" released by "delete_snapshot" :: held 1.527s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:40 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Created reservations ['a0ed3c94-a394-4949-af1b-a00ab6cde4f7', '0d6e0d4c-4445-462b-a43e-713be3e41146', '7518595a-1a71-491a-aab1-aa71a73b6b90', '0940020e-61fb-439c-ac7a-e08d181e6d9c', '67a64417-67f6-4788-8537-2d5ba84ef0af'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Delete snapshot completed successfully. Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-84b5d9ed-af11-4523-be58-3dbaf4e79489 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-056bb65b-2062-4f71-b070-2171a7575e5e-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:40 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b 1G" returned: 0 in 0.504s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:40 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b Sep 23 00:37:40 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "cinder-quobyte-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae342ca-4ff5-44bd-9b85-13f222b501b8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:40 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:40 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Deleted volume successfully. Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-66bf11fb-a3f2-45e0-8a12-308db3f79ba8 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-9c0c5d06-e8b6-4cdb-b74c-f7cb2a3331b0-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:40 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 Sep 23 00:37:40 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b" returned: 0 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b is being set with open permissions: ugo+rw Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-6f792101-9580-4320-a1bc-04fedcfb9572-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:40 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b Sep 23 00:37:40 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-6f792101-9580-4320-a1bc-04fedcfb9572-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-6f792101-9580-4320-a1bc-04fedcfb9572" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-6f792101-9580-4320-a1bc-04fedcfb9572" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53326a28-d936-4447-9d76-c99f49261f4f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:40 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" returned: 0 in 0.392s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553 Sep 23 00:37:41 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 Sep 23 00:37:41 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b" returned: 0 in 0.304s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info Sep 23 00:37:41 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" returned: 0 in 0.263s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-quobyte-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553" released by "delete_volume" :: held 0.713s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Created reservations ['b9e7498a-82f3-4959-9aa1-d6eec9ec84ac', '4e521efd-07c6-4fa7-9407-13c3649d8163', '07bfefb7-312d-4af3-9ee3-bc9a9bfbd1cf', '91398f7d-75da-4c06-8581-a2353d7aaf84', '7ae5d4de-5c08-430b-b9e5-1662d50c6082'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:41 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572" returned: 0 in 0.420s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572 Sep 23 00:37:41 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:41 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info" returned: 0 in 0.330s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info is being set with open permissions: ugo+rw Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:41 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info Sep 23 00:37:41 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f792101-9580-4320-a1bc-04fedcfb9572" returned: 0 in 0.262s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-6f792101-9580-4320-a1bc-04fedcfb9572" released by "delete_volume" :: held 0.760s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Created reservations ['d28f5094-4911-4f96-8dc2-dd91648a7903', '92144aea-a400-45b9-a093-f0dd9e56c7b7', '647f125c-9d2e-4493-9946-c78181957fb2', '4b8dd57f-39e8-474d-bd7a-3351ebc78b9b', '87214599-72ac-49ca-8094-63ce1429c9c5'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:41 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.325s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.info" returned: 0 in 0.324s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Deleted volume successfully. Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-803e4452-015f-4c6b-a10c-cbc212e181e1 tempest-SnapshotDependencyTests-715448918 None] Lock "cinder-bfe7eb4f-d40d-4aa6-9ae5-91c01f809553-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:41 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-30c0139f-ac2e-4b3f-abe5-0b66f962179d tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:41 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:41 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.300s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:42 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Deleted volume successfully. Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-71e09c44-6cf9-437a-ac26-34cb67b5fe70 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-6f792101-9580-4320-a1bc-04fedcfb9572-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (40d76f5a-a4ea-4b68-8a2d-f0a2bf9ac35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc8fdf1-0e0e-47e5-952a-d4aaa222b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc8fdf1-0e0e-47e5-952a-d4aaa222b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412597588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ab3299-e8b2-47aa-9495-a496808bb00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:42Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcc82e9-e406-4975-882d-d283221f4918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcc82e9-e406-4975-882d-d283221f4918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f01c39f-051c-4db3-9d8c-22ce379ecb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f01c39f-051c-4db3-9d8c-22ce379ecb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ab3299-e8b2-47aa-9495-a496808bb00c', 'volume_name': 'volume-05ab3299-e8b2-47aa-9495-a496808bb00c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae17b968-0227-48dd-91be-795e79bee58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae17b968-0227-48dd-91be-795e79bee58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1cd2ff-c0df-410c-b571-b8964f7c5d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:42 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Volume 05ab3299-e8b2-47aa-9495-a496808bb00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ab3299-e8b2-47aa-9495-a496808bb00c', 'volume_size': 1} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412597588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ab3299-e8b2-47aa-9495-a496808bb00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:42Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Creating volume 05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:42 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:42 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c 1073741824 Sep 23 00:37:42 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-2c405c99-78d5-4367-a933-fba859b5502b-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Lock "cinder-2c405c99-78d5-4367-a933-fba859b5502b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-f9cb1227-6f2c-4547-ab44-53cb12d32473" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-f9cb1227-6f2c-4547-ab44-53cb12d32473" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-2c405c99-78d5-4367-a933-fba859b5502b" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-2c405c99-78d5-4367-a933-fba859b5502b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot 2c405c99-78d5-4367-a933-fba859b5502b of volume f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b618459-d68c-4532-b8f6-776b8de83aa5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:42 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:42 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b Sep 23 00:37:42 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c 1073741824" returned: 0 in 0.499s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:43 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c Sep 23 00:37:43 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b" returned: 0 in 0.440s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9cb1227-6f2c-4547-ab44-53cb12d32473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2fc290-74dd-4ed9-8ce3-e67339216d4f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:43 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 Sep 23 00:37:43 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1cd2ff-c0df-410c-b571-b8964f7c5d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ab3299-e8b2-47aa-9495-a496808bb00c', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26fa164-8551-43df-9c48-51939056ffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:43 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Volume volume-05ab3299-e8b2-47aa-9495-a496808bb00c (05ab3299-e8b2-47aa-9495-a496808bb00c): created successfully Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26fa164-8551-43df-9c48-51939056ffe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (40d76f5a-a4ea-4b68-8a2d-f0a2bf9ac35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:43 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d159bea7-3617-47c9-8b8c-b32641ea803e tempest-ProjectReaderTests-1092376017 None] Created volume successfully. Sep 23 00:37:43 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473" returned: 0 in 0.429s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:43 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b Sep 23 00:37:43 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b" returned: 0 in 0.370s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b Sep 23 00:37:44 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473.2c405c99-78d5-4367-a933-fba859b5502b" returned: 0 in 0.271s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-2c405c99-78d5-4367-a933-fba859b5502b" released by "_delete_snapshot" :: held 1.645s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-f9cb1227-6f2c-4547-ab44-53cb12d32473" released by "delete_snapshot" :: held 1.668s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Created reservations ['5bfec802-cc5f-408a-b00d-75877fab6596', '56484a34-697f-4452-8064-ec9e137f4c30', 'de0830d3-08a2-43fb-bd7b-c7fd16c5f1cb', 'b0793cf9-43d0-49c0-851f-37a893d52e09', 'df956396-c242-432d-ae25-212f0c4df055'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:44 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-b825345d-6b0d-4434-99c6-3621d5c13c5a tempest-ProjectMemberTests-292579576 None] Lock "cinder-2c405c99-78d5-4367-a933-fba859b5502b-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Creating offline snapshot 24d72244-840e-40d0-8956-234e9a63924f of volume 05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-f9cb1227-6f2c-4547-ab44-53cb12d32473-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-f9cb1227-6f2c-4547-ab44-53cb12d32473-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e33546-d701-4533-a5b2-36bed7e303fb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-f9cb1227-6f2c-4547-ab44-53cb12d32473" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:44 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-f9cb1227-6f2c-4547-ab44-53cb12d32473" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[237c256d-d3a5-41f4-9fd1-29f489599053]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c Sep 23 00:37:45 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 Sep 23 00:37:45 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c" returned: 0 in 0.458s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f 1G Sep 23 00:37:45 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473" returned: 0 in 0.411s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473 Sep 23 00:37:45 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-f9cb1227-6f2c-4547-ab44-53cb12d32473" returned: 0 in 0.342s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-f9cb1227-6f2c-4547-ab44-53cb12d32473" released by "delete_volume" :: held 0.844s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:45 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Created reservations ['c64355a9-df8f-4dee-b7e7-089ca6e66e78', 'd31c1c7a-ed57-4025-a35a-cf4ec4956857', '14cdd6e1-8ccb-403e-927c-d0b74771a8ec', 'ffe4728c-1d87-4c95-b175-6aa171c12e7c', '17af6679-9df2-4b8c-9c20-0697303a6abe'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:45 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f 1G" returned: 0 in 0.624s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05ab3299-e8b2-47aa-9495-a496808bb00c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:46 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05ab3299-e8b2-47aa-9495-a496808bb00c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f Sep 23 00:37:46 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:46 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.317s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:46 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:37:46 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-9fc3da68-da40-45bf-ad8b-2c7e60ee54c1 tempest-ProjectMemberTests-292579576 None] Lock "cinder-f9cb1227-6f2c-4547-ab44-53cb12d32473-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05ab3299-e8b2-47aa-9495-a496808bb00c -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f" returned: 0 in 0.410s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f is being set with open permissions: ugo+rw Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f Sep 23 00:37:46 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (3e2ba295-fe03-42d1-8206-afdcedea4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29647111-ec97-4d75-9949-2ba49baa792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29647111-ec97-4d75-9949-2ba49baa792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1946099161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545bcdc5-9c73-433e-92b8-3d6fd66ed20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:47Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2304e771-3278-4ae3-ac39-9d672efeaeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2304e771-3278-4ae3-ac39-9d672efeaeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5b73d-ab04-4d96-9d6e-79603f781d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5b73d-ab04-4d96-9d6e-79603f781d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545bcdc5-9c73-433e-92b8-3d6fd66ed20a', 'volume_name': 'volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98850b97-4ac3-4735-b9c4-7d71a6fd5622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98850b97-4ac3-4735-b9c4-7d71a6fd5622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d99ee8-2675-4fc8-93bb-f004cd931e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:46 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Volume 545bcdc5-9c73-433e-92b8-3d6fd66ed20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a', 'volume_size': 1} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:46 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f" returned: 0 in 0.347s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info Sep 23 00:37:46 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:47 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:47 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info is being set with open permissions: ugo+rw Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:47 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info Sep 23 00:37:47 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:47 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.info" returned: 0 in 0.255s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1946099161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545bcdc5-9c73-433e-92b8-3d6fd66ed20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:47Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Creating volume 545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:47 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:47 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a 1073741824 Sep 23 00:37:47 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:47 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-1eb6c4bd-1d4d-4166-b5ed-edefc7df850a tempest-ProjectReaderTests-1092376017 None] Create snapshot completed successfully Sep 23 00:37:47 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a 1073741824" returned: 0 in 0.504s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:47 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:47 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a Sep 23 00:37:47 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-24d72244-840e-40d0-8956-234e9a63924f-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-24d72244-840e-40d0-8956-234e9a63924f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-05ab3299-e8b2-47aa-9495-a496808bb00c" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-05ab3299-e8b2-47aa-9495-a496808bb00c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-24d72244-840e-40d0-8956-234e9a63924f" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-24d72244-840e-40d0-8956-234e9a63924f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Deleting offline snapshot 24d72244-840e-40d0-8956-234e9a63924f of volume 05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] snapshot_file for this snap is: volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:48 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f076f5-b5f6-4c43-ab9e-3631d02d3201]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d99ee8-2675-4fc8-93bb-f004cd931e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b08e580-00c7-4117-9782-541e002c0379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:48 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Volume volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a (545bcdc5-9c73-433e-92b8-3d6fd66ed20a): created successfully Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b08e580-00c7-4117-9782-541e002c0379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (3e2ba295-fe03-42d1-8206-afdcedea4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:48 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-19ac5023-56a9-4308-8b0d-d4c92cb70a67 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:37:48 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f Sep 23 00:37:48 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f" returned: 0 in 0.421s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05ab3299-e8b2-47aa-9495-a496808bb00c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[940a48e8-04dd-44c9-aa00-cd9517fdf003]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c Sep 23 00:37:48 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Creating offline snapshot bbd7a3c3-12ad-4fd7-8359-e236fcae4766 of volume 545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e3962-1947-473f-b46f-d9a51aa5ac2b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:48 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c" returned: 0 in 0.415s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a Sep 23 00:37:49 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f Sep 23 00:37:49 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" returned: 0 in 0.459s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f" returned: 0 in 0.386s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 1G Sep 23 00:37:49 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f Sep 23 00:37:49 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c.24d72244-840e-40d0-8956-234e9a63924f" returned: 0 in 0.328s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-24d72244-840e-40d0-8956-234e9a63924f" released by "_delete_snapshot" :: held 1.687s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-05ab3299-e8b2-47aa-9495-a496808bb00c" released by "delete_snapshot" :: held 1.715s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:49 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Created reservations ['66e86840-f0f5-4df9-95e9-aa175f2ffecb', '70f0c82a-ae40-47e3-a98e-280a197e821d', '25bf6f5c-401e-4f83-8128-deab76c5cbfe', '6d5e7a92-b120-4ce8-aa3f-6146c5f7a0bb', 'db6c6907-d982-4872-a903-8d48b9a3fca4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:49 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 1G" returned: 0 in 0.552s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 Sep 23 00:37:50 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:50 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Delete snapshot completed successfully. Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-a9f6a839-abe5-42f5-852a-d4400fd512c5 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-24d72244-840e-40d0-8956-234e9a63924f-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-05ab3299-e8b2-47aa-9495-a496808bb00c-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Lock "cinder-05ab3299-e8b2-47aa-9495-a496808bb00c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-05ab3299-e8b2-47aa-9495-a496808bb00c" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-05ab3299-e8b2-47aa-9495-a496808bb00c" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:50 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766" returned: 0 in 0.358s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 is being set with open permissions: ugo+rw Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daff0d7-b7aa-4090-bbb0-5a5562922f99]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 Sep 23 00:37:50 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:50 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c Sep 23 00:37:50 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:50 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766" returned: 0 in 0.293s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info Sep 23 00:37:50 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:50 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c" returned: 0 in 0.483s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c Sep 23 00:37:50 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:51 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info" returned: 0 in 0.369s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:51 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info is being set with open permissions: ugo+rw Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:51 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info Sep 23 00:37:51 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:51 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-05ab3299-e8b2-47aa-9495-a496808bb00c" returned: 0 in 0.332s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-05ab3299-e8b2-47aa-9495-a496808bb00c" released by "delete_volume" :: held 0.892s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Created reservations ['28eefb9a-c6af-44d0-8407-0dd3f85056d2', '38547ce9-3373-4e71-8f46-4665920e9281', '1eedd09e-d492-4f82-b932-ef6cfd0734a9', 'be1cb177-4479-454d-8e0b-569c0fd679fd', 'b146f26b-8d6c-4b7f-9282-349d6c191ae7'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:51 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.info" returned: 0 in 0.318s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-287af83e-efe4-4081-9e56-f82696c96919 tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:51 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:51 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:51 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Deleted volume successfully. Sep 23 00:37:51 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ebca85f2-6577-49ca-9bad-e90d3ebf86df tempest-ProjectReaderTests-1092376017 None] Lock "cinder-05ab3299-e8b2-47aa-9495-a496808bb00c-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-bbd7a3c3-12ad-4fd7-8359-e236fcae4766-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Lock "cinder-bbd7a3c3-12ad-4fd7-8359-e236fcae4766-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-bbd7a3c3-12ad-4fd7-8359-e236fcae4766" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-bbd7a3c3-12ad-4fd7-8359-e236fcae4766" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot bbd7a3c3-12ad-4fd7-8359-e236fcae4766 of volume 545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b899e-4a39-4c8a-a884-6b2aa177b1c7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:52 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 Sep 23 00:37:52 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:52 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766" returned: 0 in 0.463s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c881b8a1-4155-43cc-8532-cb4d1f3add6f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:52 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:52 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a Sep 23 00:37:52 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" returned: 0 in 0.517s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 Sep 23 00:37:53 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (c0222442-f3f7-4a0e-96ef-0374c99c1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54872962-fccf-4f45-a12e-8cf21fa98a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54872962-fccf-4f45-a12e-8cf21fa98a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611069620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065a6f3e-0d1a-47d8-99b4-74372fc77d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:53Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc25e582-c647-4b49-a73d-9cc5f69084e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc25e582-c647-4b49-a73d-9cc5f69084e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96f329b-665d-4685-aa19-27c575c2f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96f329b-665d-4685-aa19-27c575c2f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065a6f3e-0d1a-47d8-99b4-74372fc77d03', 'volume_name': 'volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e80c6e-8423-4c73-9f32-71719fbfd5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e80c6e-8423-4c73-9f32-71719fbfd5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93760658-d9a5-4eb1-87b8-b0c0ee528839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:53 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Volume 065a6f3e-0d1a-47d8-99b4-74372fc77d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03', 'volume_size': 1} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611069620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065a6f3e-0d1a-47d8-99b4-74372fc77d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:53Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Creating volume 065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:53 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 1073741824 Sep 23 00:37:53 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766" returned: 0 in 0.455s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766 Sep 23 00:37:53 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 1073741824" returned: 0 in 0.598s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=185,cinder:UPDATE=243,cinder:INSERT=65,cinder:DELETE=17 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:37:54 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a.bbd7a3c3-12ad-4fd7-8359-e236fcae4766" returned: 0 in 0.359s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-bbd7a3c3-12ad-4fd7-8359-e236fcae4766" released by "_delete_snapshot" :: held 1.947s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" released by "delete_snapshot" :: held 1.978s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:54 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 Sep 23 00:37:54 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Created reservations ['8f5a2c78-e84e-4c9a-ab7b-8d6dfa516a69', 'c19d801d-07a4-4021-822d-ab16918f2877', '22ffe3b7-7315-4e17-aadd-1653782d4466', '464c8a51-4253-49d8-8fb2-8a1c2837d8c5', '95b11a4c-ea4d-40bb-9897-9cbe96a881e0'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-029f47e1-1453-40a2-b070-df6e47ad8a05 tempest-ProjectMemberTests-292579576 None] Lock "cinder-bbd7a3c3-12ad-4fd7-8359-e236fcae4766-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:54 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03" returned: 0 in 0.298s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93760658-d9a5-4eb1-87b8-b0c0ee528839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52297d10-461e-4dc1-b488-0ef59c0de4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:54 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Volume volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 (065a6f3e-0d1a-47d8-99b4-74372fc77d03): created successfully Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52297d10-461e-4dc1-b488-0ef59c0de4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:54 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (c0222442-f3f7-4a0e-96ef-0374c99c1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:54 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f1432625-321a-4e7e-b7b5-9221179b059a tempest-ProjectReaderTests-1092376017 None] Created volume successfully. Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:55 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:55 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.286s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-545bcdc5-9c73-433e-92b8-3d6fd66ed20a-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Lock "cinder-545bcdc5-9c73-433e-92b8-3d6fd66ed20a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:INSERT=76,cinder:SELECT=211,cinder:UPDATE=241,cinder:DELETE=20 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" acquired by "delete_volume" :: waited 0.029s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[928363f3-2162-4972-9b72-2f335b463ec3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Creating offline snapshot 2bf94651-1048-4cb7-8e21-5c5e76e749b7 of volume 065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aec27e-cb08-4e86-bf6d-f26e5d969c75]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:55 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a Sep 23 00:37:55 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 Sep 23 00:37:55 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" returned: 0 in 0.376s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:55 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a Sep 23 00:37:55 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03" returned: 0 in 0.397s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 1G Sep 23 00:37:56 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:56 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" returned: 0 in 0.278s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-545bcdc5-9c73-433e-92b8-3d6fd66ed20a" released by "delete_volume" :: held 0.724s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Created reservations ['2570c080-72fc-4899-b110-50e4fcc24f37', 'edb909f3-e282-4a2c-906e-1140d9b5b606', 'c8f3f538-27e2-4ce3-be59-4aa309fab851', '7742250e-fe5c-4833-99f6-512fcc5908a8', '7d5f611e-a1ce-43ca-b9ae-a7ba19cccb0f'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:37:56 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:56 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 1G" returned: 0 in 0.450s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 Sep 23 00:37:56 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:56 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.317s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:56 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c289055f-0b93-46be-969f-a5ffd848c903 tempest-ProjectMemberTests-292579576 None] Lock "cinder-545bcdc5-9c73-433e-92b8-3d6fd66ed20a-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:56 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7" returned: 0 in 0.389s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:56 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 is being set with open permissions: ugo+rw Sep 23 00:37:56 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 Sep 23 00:37:56 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (5aa8cd0c-94ed-4f57-98c1-dfe3a11f44f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a956cd82-a23f-44fe-8088-575f92e238c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:57 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a956cd82-a23f-44fe-8088-575f92e238c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035769118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4066da2-ff0e-4dcd-b6d8-4e110d43dddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:57Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67f4001-2784-4217-8c07-240a94abb0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67f4001-2784-4217-8c07-240a94abb0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef14f5cf-d4f2-467e-9796-aa111fd821c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef14f5cf-d4f2-467e-9796-aa111fd821c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4066da2-ff0e-4dcd-b6d8-4e110d43dddb', 'volume_name': 'volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da36a618-85b4-49db-a9dc-d8fec7726ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da36a618-85b4-49db-a9dc-d8fec7726ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c44d37-aa98-4167-8a2f-c099194ded21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:57 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Volume d4066da2-ff0e-4dcd-b6d8-4e110d43dddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb', 'volume_size': 1} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7" returned: 0 in 0.365s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info Sep 23 00:37:57 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info is being set with open permissions: ugo+rw Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info Sep 23 00:37:57 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.info" returned: 0 in 0.274s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035769118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4066da2-ff0e-4dcd-b6d8-4e110d43dddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:57Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Creating volume d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:57 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:37:57 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb 1073741824 Sep 23 00:37:57 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-a3c8499d-5e59-41f4-a413-230b252bb71c tempest-ProjectReaderTests-1092376017 None] Create snapshot completed successfully Sep 23 00:37:58 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb 1073741824" returned: 0 in 0.440s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:58 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb Sep 23 00:37:58 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:58 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" returned: 0 in 0.248s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c44d37-aa98-4167-8a2f-c099194ded21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c21e74-e498-4f7b-9f53-b25ad766401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:58 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Volume volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb (d4066da2-ff0e-4dcd-b6d8-4e110d43dddb): created successfully Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c21e74-e498-4f7b-9f53-b25ad766401f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (5aa8cd0c-94ed-4f57-98c1-dfe3a11f44f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:58 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-bb27c17b-6642-44ed-9069-88e3f2295393 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-2bf94651-1048-4cb7-8e21-5c5e76e749b7-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-2bf94651-1048-4cb7-8e21-5c5e76e749b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-065a6f3e-0d1a-47d8-99b4-74372fc77d03" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-065a6f3e-0d1a-47d8-99b4-74372fc77d03" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-2bf94651-1048-4cb7-8e21-5c5e76e749b7" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-2bf94651-1048-4cb7-8e21-5c5e76e749b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Deleting offline snapshot 2bf94651-1048-4cb7-8e21-5c5e76e749b7 of volume 065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] snapshot_file for this snap is: volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[517a1672-e016-4d15-a9f0-0b275e5f68c8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:58 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:58 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 Sep 23 00:37:58 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7" returned: 0 in 0.366s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c8317-25c8-42db-ad7b-cd5cfba24c5d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 Sep 23 00:37:59 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Creating offline snapshot 46d51c68-74f8-4d94-ba9a-448af62352f1 of volume d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd2681-b267-436e-a807-c2c5b33adbc0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb Sep 23 00:37:59 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03" returned: 0 in 0.403s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 Sep 23 00:37:59 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" returned: 0 in 0.380s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 1G Sep 23 00:37:59 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7" returned: 0 in 0.344s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7 Sep 23 00:37:59 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 1G" returned: 0 in 0.411s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03.2bf94651-1048-4cb7-8e21-5c5e76e749b7" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 Sep 23 00:38:00 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-2bf94651-1048-4cb7-8e21-5c5e76e749b7" released by "_delete_snapshot" :: held 1.490s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-065a6f3e-0d1a-47d8-99b4-74372fc77d03" released by "delete_snapshot" :: held 1.511s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Created reservations ['09853446-6cc0-47e8-be30-390cd6920c03', '615853c4-2403-4cbb-80f5-d06f7a164526', '465705ff-55f3-466e-a253-0ab736486064', '1c42e02e-b775-4736-ae5b-3caa9731bb94', 'deb54c71-b1b2-44ab-87fe-97f1cc738d63'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:00 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Delete snapshot completed successfully. Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-d68169db-8c34-4a7e-a238-e4d8b6671460 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-2bf94651-1048-4cb7-8e21-5c5e76e749b7-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:00 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1" returned: 0 in 0.299s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 is being set with open permissions: ugo+rw Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 Sep 23 00:38:00 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1" returned: 0 in 0.243s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info Sep 23 00:38:00 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-065a6f3e-0d1a-47d8-99b4-74372fc77d03-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-065a6f3e-0d1a-47d8-99b4-74372fc77d03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-065a6f3e-0d1a-47d8-99b4-74372fc77d03" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-065a6f3e-0d1a-47d8-99b4-74372fc77d03" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eea448-7759-42d6-82e2-94f1bab323f4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:00 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:01 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info" returned: 0 in 0.312s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:01 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info is being set with open permissions: ugo+rw Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:01 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info Sep 23 00:38:01 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:01 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 Sep 23 00:38:01 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:01 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.info" returned: 0 in 0.251s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:01 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-af635943-9ecd-4942-82ab-ad66d2468604 tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:38:01 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03" returned: 0 in 0.430s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:01 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03 Sep 23 00:38:01 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-46d51c68-74f8-4d94-ba9a-448af62352f1-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Lock "cinder-46d51c68-74f8-4d94-ba9a-448af62352f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-46d51c68-74f8-4d94-ba9a-448af62352f1" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-46d51c68-74f8-4d94-ba9a-448af62352f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot 46d51c68-74f8-4d94-ba9a-448af62352f1 of volume d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[82876511-8e55-4d62-af4b-9e06c2a91fcf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:01 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-065a6f3e-0d1a-47d8-99b4-74372fc77d03" returned: 0 in 0.271s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-065a6f3e-0d1a-47d8-99b4-74372fc77d03" released by "delete_volume" :: held 0.777s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:01 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 Sep 23 00:38:01 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Created reservations ['3927e1bd-4559-49f3-8e29-834f72b41ab4', 'c48cd31d-1a58-4fa6-af02-b3611b24e94f', 'd4be30ca-f388-472b-9432-70e901a8ca88', '11e74423-3d43-4c60-8881-e941999a83a8', '095ae992-26ea-4829-89f1-964379aa5502'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:01 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:01 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:01 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1" returned: 0 in 0.417s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10abb206-57bb-483f-b6de-64b8ad97f54d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.312s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:02 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Deleted volume successfully. Sep 23 00:38:02 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb Sep 23 00:38:02 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-3fd03e5e-e8d1-47ef-95e8-c243e41f2124 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-065a6f3e-0d1a-47d8-99b4-74372fc77d03-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:02 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" returned: 0 in 0.449s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 Sep 23 00:38:02 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (db5b9c2d-c847-4101-a5cd-8ac28d37f97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f84fd61-38cf-442a-809f-a9c1fb8dba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f84fd61-38cf-442a-809f-a9c1fb8dba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913198883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26419ae9-108d-4ff1-a903-39a35a4d669e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:03Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b55ed4b-60ff-46c4-aa4f-2ae43b7781d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b55ed4b-60ff-46c4-aa4f-2ae43b7781d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d32464c-4548-4edc-ae46-fff0a337a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d32464c-4548-4edc-ae46-fff0a337a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26419ae9-108d-4ff1-a903-39a35a4d669e', 'volume_name': 'volume-26419ae9-108d-4ff1-a903-39a35a4d669e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d6c10a-0bb4-4ae3-a055-5ac03467f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d6c10a-0bb4-4ae3-a055-5ac03467f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99679621-ae4b-40aa-b40b-8b30b1173bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:02 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Volume 26419ae9-108d-4ff1-a903-39a35a4d669e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26419ae9-108d-4ff1-a903-39a35a4d669e', 'volume_size': 1} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913198883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26419ae9-108d-4ff1-a903-39a35a4d669e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:03Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Creating volume 26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:02 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e 1073741824 Sep 23 00:38:02 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1" returned: 0 in 0.352s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1 Sep 23 00:38:02 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:03 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e 1073741824" returned: 0 in 0.476s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:03 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb.46d51c68-74f8-4d94-ba9a-448af62352f1" returned: 0 in 0.312s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e Sep 23 00:38:03 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-46d51c68-74f8-4d94-ba9a-448af62352f1" released by "_delete_snapshot" :: held 1.647s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" released by "delete_snapshot" :: held 1.674s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Created reservations ['52a1b9f3-ee07-406e-9787-5deca3cbe4e6', 'e02f2ce1-0bae-4df6-bf5e-e65863f51f56', 'd1e8e99a-5270-4435-b6eb-1c2c06e823b4', 'c671992c-206a-4ee1-8b32-8c9a5ba01b9a', '86fa1407-2305-4d30-b4eb-680ce4195d18'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2024beb5-9f55-430d-8942-b3929c95524d tempest-ProjectMemberTests-292579576 None] Lock "cinder-46d51c68-74f8-4d94-ba9a-448af62352f1-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:03 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e" returned: 0 in 0.273s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99679621-ae4b-40aa-b40b-8b30b1173bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26419ae9-108d-4ff1-a903-39a35a4d669e', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4f97d7-66e7-473f-910f-d611ad498afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:03 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Volume volume-26419ae9-108d-4ff1-a903-39a35a4d669e (26419ae9-108d-4ff1-a903-39a35a4d669e): created successfully Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4f97d7-66e7-473f-910f-d611ad498afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (db5b9c2d-c847-4101-a5cd-8ac28d37f97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:03 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ae60eb77-c97f-4606-898c-3e11fa287651 tempest-ProjectReaderTests-1092376017 None] Created volume successfully. Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Lock "cinder-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" acquired by "delete_volume" :: waited 0.031s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b2329-96c1-4290-bbac-1ca7c57aacf8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Creating offline snapshot c6bbaa9f-8972-4861-8a93-dae723cd0a5c of volume 26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1054d2-bb29-4dda-9c53-0913388dd219]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:03 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:03 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb Sep 23 00:38:03 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e Sep 23 00:38:04 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" returned: 0 in 0.373s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb Sep 23 00:38:04 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e" returned: 0 in 0.421s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c 1G Sep 23 00:38:04 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" returned: 0 in 0.269s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb" released by "delete_volume" :: held 0.710s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Created reservations ['a2dc235b-544a-4e12-8589-7d92b24f08e0', '6de01445-b240-4b9a-ae6b-4fab8f59582b', '0e3e8ffe-c046-48a0-80cc-feee46eb0148', 'c58921c7-4d87-44f7-85c0-2cca65ee1ef3', 'd51b9a7b-cb96-45e1-9e43-f51e693672ee'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:04 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c 1G" returned: 0 in 0.487s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26419ae9-108d-4ff1-a903-39a35a4d669e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26419ae9-108d-4ff1-a903-39a35a4d669e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c Sep 23 00:38:04 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.315s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:05 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-ee9258a7-9173-46ae-b7e5-a6ac0bc48e58 tempest-ProjectMemberTests-292579576 None] Lock "cinder-d4066da2-ff0e-4dcd-b6d8-4e110d43dddb-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:05 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26419ae9-108d-4ff1-a903-39a35a4d669e -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c" returned: 0 in 0.358s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:05 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c is being set with open permissions: ugo+rw Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:05 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c Sep 23 00:38:05 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:05 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c" returned: 0 in 0.262s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:05 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info Sep 23 00:38:05 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (bb2d2dec-fe02-4a0b-92da-ae73e0e15945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec020105-1b2d-4c3c-b7c7-1a8b881f0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec020105-1b2d-4c3c-b7c7-1a8b881f0753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909202483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513248e0-eff7-4991-a731-6b0cf9048fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:05Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fa533d-abed-4d5d-a7d1-4fde50a36f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fa533d-abed-4d5d-a7d1-4fde50a36f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b78cf63-5ad8-400c-81c7-e9634c1e091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b78cf63-5ad8-400c-81c7-e9634c1e091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513248e0-eff7-4991-a731-6b0cf9048fa9', 'volume_name': 'volume-513248e0-eff7-4991-a731-6b0cf9048fa9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116174c2-7766-4b7d-a418-22a5097d033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116174c2-7766-4b7d-a418-22a5097d033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e61910-29e2-4c9c-8e25-3fd1efe9559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:05 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Volume 513248e0-eff7-4991-a731-6b0cf9048fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513248e0-eff7-4991-a731-6b0cf9048fa9', 'volume_size': 1} Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:05 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info" returned: 0 in 0.268s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:05 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info is being set with open permissions: ugo+rw Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:05 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info Sep 23 00:38:05 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:05 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:05 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.info" returned: 0 in 0.247s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909202483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513248e0-eff7-4991-a731-6b0cf9048fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:05Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Creating volume 513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:06 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:06 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 1073741824 Sep 23 00:38:06 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-3f0c3df0-de36-40a8-9030-9736c2a3aee4 tempest-ProjectReaderTests-1092376017 None] Create snapshot completed successfully Sep 23 00:38:06 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 1073741824" returned: 0 in 0.437s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:06 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 Sep 23 00:38:06 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:06 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9" returned: 0 in 0.242s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e61910-29e2-4c9c-8e25-3fd1efe9559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513248e0-eff7-4991-a731-6b0cf9048fa9', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47591298-353a-455a-a0f5-a8b34022973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:06 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Volume volume-513248e0-eff7-4991-a731-6b0cf9048fa9 (513248e0-eff7-4991-a731-6b0cf9048fa9): created successfully Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47591298-353a-455a-a0f5-a8b34022973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:06 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (bb2d2dec-fe02-4a0b-92da-ae73e0e15945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:06 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-5fbaff4f-d3e6-431c-ade8-ef1c5dcc810c tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-c6bbaa9f-8972-4861-8a93-dae723cd0a5c-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-c6bbaa9f-8972-4861-8a93-dae723cd0a5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-26419ae9-108d-4ff1-a903-39a35a4d669e" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-26419ae9-108d-4ff1-a903-39a35a4d669e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-c6bbaa9f-8972-4861-8a93-dae723cd0a5c" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-c6bbaa9f-8972-4861-8a93-dae723cd0a5c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Deleting offline snapshot c6bbaa9f-8972-4861-8a93-dae723cd0a5c of volume 26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] snapshot_file for this snap is: volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a94a5e-3eb5-48f8-a0b9-bd2692028b63]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:07 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c Sep 23 00:38:07 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:07 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c" returned: 0 in 0.381s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26419ae9-108d-4ff1-a903-39a35a4d669e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d81d0d3-4840-49a8-bab0-85878a2f973d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:07 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e Sep 23 00:38:07 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Creating offline snapshot b22404f7-a5b9-4ff4-a7cc-cd184381a821 of volume 513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0492a0f-d75d-4eba-8b4b-5b4a04dc315d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:07 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 Sep 23 00:38:07 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:07 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e" returned: 0 in 0.389s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:07 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:07 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c Sep 23 00:38:07 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:08 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9" returned: 0 in 0.400s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:08 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 1G Sep 23 00:38:08 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:08 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c" returned: 0 in 0.342s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:08 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c Sep 23 00:38:08 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:08 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e.c6bbaa9f-8972-4861-8a93-dae723cd0a5c" returned: 0 in 0.265s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:08 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 1G" returned: 0 in 0.389s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513248e0-eff7-4991-a731-6b0cf9048fa9 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-c6bbaa9f-8972-4861-8a93-dae723cd0a5c" released by "_delete_snapshot" :: held 1.488s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-26419ae9-108d-4ff1-a903-39a35a4d669e" released by "delete_snapshot" :: held 1.515s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:08 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513248e0-eff7-4991-a731-6b0cf9048fa9 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 Sep 23 00:38:08 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Created reservations ['5bc50095-a8c6-41f1-a9e2-cfdfffd5bd71', '3a0d77c1-d746-4cf5-84a9-3f3ce34ce6d5', '9f251d2b-1ab3-4d2a-b575-fafe00e5065f', '02465fc4-5bd9-4cb2-91bd-96d964a58bef', '83c1bb89-1fda-42c2-90ba-083f8c89cd62'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:08 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Delete snapshot completed successfully. Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-750d4c8e-9ef7-4250-a49c-b70ee6498850 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-c6bbaa9f-8972-4861-8a93-dae723cd0a5c-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:08 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513248e0-eff7-4991-a731-6b0cf9048fa9 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821" returned: 0 in 0.292s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:08 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 is being set with open permissions: ugo+rw Sep 23 00:38:08 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:08 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 Sep 23 00:38:08 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821" returned: 0 in 0.243s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:09 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info Sep 23 00:38:09 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-26419ae9-108d-4ff1-a903-39a35a4d669e-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-26419ae9-108d-4ff1-a903-39a35a4d669e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-26419ae9-108d-4ff1-a903-39a35a4d669e" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-26419ae9-108d-4ff1-a903-39a35a4d669e" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb1198-7c9c-488a-9486-bd1bf3ef0cba]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:09 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info" returned: 0 in 0.311s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info is being set with open permissions: ugo+rw Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:09 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e Sep 23 00:38:09 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info Sep 23 00:38:09 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e" returned: 0 in 0.367s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:09 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.info" returned: 0 in 0.279s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e Sep 23 00:38:09 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:09 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-df412ab9-08cd-4302-9ee6-d8cc6a139159 tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:38:09 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-26419ae9-108d-4ff1-a903-39a35a4d669e" returned: 0 in 0.250s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-26419ae9-108d-4ff1-a903-39a35a4d669e" released by "delete_volume" :: held 0.691s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:09 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Created reservations ['445ae0cf-47ed-4003-9ba9-15d41544656f', '38490077-c82a-4680-944a-8e0460bbbf18', 'a8763033-39b6-47ad-99cf-7a799e273b6a', '2bfdda6b-e86d-426a-9c8a-00a6f3fb0a81', 'c9af8602-4c52-49b3-b268-f888bf381ae1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:10 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:10 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:10 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.263s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:10 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Deleted volume successfully. Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-c4a61774-3ef2-4408-a76b-c8da34f5e719 tempest-ProjectReaderTests-1092376017 None] Lock "cinder-26419ae9-108d-4ff1-a903-39a35a4d669e-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (793505b5-6016-435b-9d8f-1642a1aab8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7b94a9-4c6d-4e8a-ba39-af05f37e03bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7b94a9-4c6d-4e8a-ba39-af05f37e03bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179901537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d399adb6-36bd-43ae-a54e-4b5ae3ae6493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:11Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5cd9a7-cd1c-4a9c-af67-e7b8ec5d09fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5cd9a7-cd1c-4a9c-af67-e7b8ec5d09fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c3d7dd-6cce-4ed3-90c5-a1c1d2ff4e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c3d7dd-6cce-4ed3-90c5-a1c1d2ff4e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd399adb6-36bd-43ae-a54e-4b5ae3ae6493', 'volume_name': 'volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fc4315-6b0c-4a94-afba-e20469b4f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fc4315-6b0c-4a94-afba-e20469b4f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc7298-5fe2-403e-9412-dee55007cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:10 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Volume d399adb6-36bd-43ae-a54e-4b5ae3ae6493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493', 'volume_size': 1} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179901537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d399adb6-36bd-43ae-a54e-4b5ae3ae6493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb17c2eb84f4d6399bc54dafc3499ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:11Z,use_quota=True,user_id='97e82ad3d07b45fe8d01c324b648386e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Creating volume d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:10 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-b22404f7-a5b9-4ff4-a7cc-cd184381a821-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:10 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 1073741824 Sep 23 00:38:10 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Lock "cinder-b22404f7-a5b9-4ff4-a7cc-cd184381a821-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-513248e0-eff7-4991-a731-6b0cf9048fa9" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-513248e0-eff7-4991-a731-6b0cf9048fa9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-b22404f7-a5b9-4ff4-a7cc-cd184381a821" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-b22404f7-a5b9-4ff4-a7cc-cd184381a821" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot b22404f7-a5b9-4ff4-a7cc-cd184381a821 of volume 513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:10 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b61b1da-2da5-4b68-8a32-8319b7a625b5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 Sep 23 00:38:11 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 1073741824" returned: 0 in 0.432s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 Sep 23 00:38:11 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821" returned: 0 in 0.394s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-513248e0-eff7-4991-a731-6b0cf9048fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c5da2-7dcd-41d2-8f9f-7a87cf45b421]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 Sep 23 00:38:11 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" returned: 0 in 0.256s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc7298-5fe2-403e-9412-dee55007cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96603b21-2ae7-42e2-b8b8-9ddc1a93e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Volume volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 (d399adb6-36bd-43ae-a54e-4b5ae3ae6493): created successfully Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96603b21-2ae7-42e2-b8b8-9ddc1a93e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Flow 'volume_create_manager' (793505b5-6016-435b-9d8f-1642a1aab8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:11 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b79ae11c-3c09-439c-a36a-2abbc6c62440 tempest-ProjectReaderTests-1092376017 None] Created volume successfully. Sep 23 00:38:11 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9" returned: 0 in 0.379s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 Sep 23 00:38:11 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Creating offline snapshot 9e3cdb4c-3eba-4b54-b46a-34deba18fdea of volume d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2dff39-4b27-4bad-b7b2-7d0e0fa09369]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 Sep 23 00:38:12 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821" returned: 0 in 0.378s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821 Sep 23 00:38:12 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" returned: 0 in 0.368s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea 1G Sep 23 00:38:12 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9.b22404f7-a5b9-4ff4-a7cc-cd184381a821" returned: 0 in 0.257s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-b22404f7-a5b9-4ff4-a7cc-cd184381a821" released by "_delete_snapshot" :: held 1.524s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-513248e0-eff7-4991-a731-6b0cf9048fa9" released by "delete_snapshot" :: held 1.552s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Created reservations ['da86b991-1999-42c7-b155-d0f0af19cae0', '3f19baa3-7645-4ad7-9d2f-4ebae780bff5', '05d4d4c4-29da-4901-bb6b-38a0ba510fb4', '874cbd33-65a4-4b18-b4a7-5da3f28816a4', '773882be-618f-4fe2-8f1a-b2c39921162a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:12 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-0c1538cd-0484-43b0-852c-c153851dceda tempest-ProjectMemberTests-292579576 None] Lock "cinder-b22404f7-a5b9-4ff4-a7cc-cd184381a821-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:12 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea 1G" returned: 0 in 0.403s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:12 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea Sep 23 00:38:12 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-513248e0-eff7-4991-a731-6b0cf9048fa9-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Lock "cinder-513248e0-eff7-4991-a731-6b0cf9048fa9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:13 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-513248e0-eff7-4991-a731-6b0cf9048fa9" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea" returned: 0 in 0.320s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea is being set with open permissions: ugo+rw Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-513248e0-eff7-4991-a731-6b0cf9048fa9" acquired by "delete_volume" :: waited 0.025s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:13 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea Sep 23 00:38:13 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b4203-83dd-4fee-b99f-6faaeac6f359]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 Sep 23 00:38:13 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea" returned: 0 in 0.247s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info Sep 23 00:38:13 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9" returned: 0 in 0.387s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9 Sep 23 00:38:13 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info" returned: 0 in 0.269s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info is being set with open permissions: ugo+rw Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info Sep 23 00:38:13 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-513248e0-eff7-4991-a731-6b0cf9048fa9" returned: 0 in 0.245s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-513248e0-eff7-4991-a731-6b0cf9048fa9" released by "delete_volume" :: held 0.698s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Created reservations ['b7741168-fba8-4de3-a633-fa3fb63ac63d', '64149169-7ec8-483d-afdc-da8bcdb9890c', 'e44a7c57-e9c2-469a-bd57-0826a11cafb9', 'f59c4fe8-dc08-4c90-bef8-a0b4f9275e2f', '1ea68128-0464-4f91-8114-07d837b020e4'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:13 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.info" returned: 0 in 0.253s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:13 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-43b020b6-f38b-437b-bda0-7b36a3b2dc84 tempest-ProjectReaderTests-1092376017 None] Create snapshot completed successfully Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:14 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:14 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-9e3cdb4c-3eba-4b54-b46a-34deba18fdea-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Lock "cinder-9e3cdb4c-3eba-4b54-b46a-34deba18fdea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-9e3cdb4c-3eba-4b54-b46a-34deba18fdea" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-9e3cdb4c-3eba-4b54-b46a-34deba18fdea" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Deleting offline snapshot 9e3cdb4c-3eba-4b54-b46a-34deba18fdea of volume d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] snapshot_file for this snap is: volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87673a8c-3c01-4b40-871a-e9714bea4e51]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:14 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.275s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:14 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-f95441f8-ab88-4913-8fb0-ab36f37a466d tempest-ProjectMemberTests-292579576 None] Lock "cinder-513248e0-eff7-4991-a731-6b0cf9048fa9-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:14 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea Sep 23 00:38:14 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:14 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea" returned: 0 in 0.405s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c509afd-0c97-4915-b209-aa4cf8e455b5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (e54f5210-5070-4c76-941e-984af32b86da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87699cba-12a1-4f60-93af-6f57c791c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87699cba-12a1-4f60-93af-6f57c791c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547293303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f221a80-9041-4aff-9bc2-b984c8b593d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:15Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ce9f03-d5c7-4653-9f8e-a65813965db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ce9f03-d5c7-4653-9f8e-a65813965db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04cacb5-955b-4968-b4f9-054d5da22314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04cacb5-955b-4968-b4f9-054d5da22314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f221a80-9041-4aff-9bc2-b984c8b593d4', 'volume_name': 'volume-6f221a80-9041-4aff-9bc2-b984c8b593d4', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3123dc2d-ab74-4dc5-9b28-8ad5527d8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3123dc2d-ab74-4dc5-9b28-8ad5527d8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:14 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 Sep 23 00:38:14 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0760c83-2840-4e19-832e-d4a358321c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:14 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Volume 6f221a80-9041-4aff-9bc2-b984c8b593d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f221a80-9041-4aff-9bc2-b984c8b593d4', 'volume_size': 1} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547293303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f221a80-9041-4aff-9bc2-b984c8b593d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:15Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Creating volume 6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:14 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:38:14 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:14 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 1073741824 Sep 23 00:38:14 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" returned: 0 in 0.408s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea Sep 23 00:38:15 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 1073741824" returned: 0 in 0.534s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 Sep 23 00:38:15 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea" returned: 0 in 0.412s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea Sep 23 00:38:15 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4" returned: 0 in 0.260s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0760c83-2840-4e19-832e-d4a358321c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f221a80-9041-4aff-9bc2-b984c8b593d4', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad71ae8-744b-4277-80a7-aabbdd410ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:15 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Volume volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 (6f221a80-9041-4aff-9bc2-b984c8b593d4): created successfully Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad71ae8-744b-4277-80a7-aabbdd410ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (e54f5210-5070-4c76-941e-984af32b86da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-b31d5d39-01f9-4f71-a1d7-0b69241bfe9a tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:38:15 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493.9e3cdb4c-3eba-4b54-b46a-34deba18fdea" returned: 0 in 0.268s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-9e3cdb4c-3eba-4b54-b46a-34deba18fdea" released by "_delete_snapshot" :: held 1.612s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" released by "delete_snapshot" :: held 1.633s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Created reservations ['c3c6af2c-3a59-4827-93c1-9fca19894906', '17832128-8c42-49bc-93df-225ba39cdc4e', 'd9088c14-c3be-404d-a58c-f4b09e602315', 'ba076bb9-1db3-4855-bcdf-3a1a4e22fba6', '89ecada7-eba7-40f9-b5c3-4f04ae1fd669'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:15 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Delete snapshot completed successfully. Sep 23 00:38:15 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-14ab7ced-9f98-4159-9e93-722a34309f4a tempest-ProjectReaderTests-1092376017 None] Lock "cinder-9e3cdb4c-3eba-4b54-b46a-34deba18fdea-delete_snapshot" released by "delete_snapshot" :: held 1.771s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-d399adb6-36bd-43ae-a54e-4b5ae3ae6493-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Lock "cinder-d399adb6-36bd-43ae-a54e-4b5ae3ae6493-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Acquiring lock "cinder-quobyte-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebc825b-228d-4edd-bd7f-b5f58cd7bdd4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:16 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 Sep 23 00:38:16 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:16 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" returned: 0 in 0.364s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:16 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493 Sep 23 00:38:16 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Creating offline snapshot 8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 of volume 6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a6750e-618b-47fb-a0ac-a145a817f13d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:16 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:17 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" returned: 0 in 0.278s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Lock "cinder-quobyte-d399adb6-36bd-43ae-a54e-4b5ae3ae6493" released by "delete_volume" :: held 0.707s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:17 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 Sep 23 00:38:17 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Created reservations ['8e069474-7e90-4e38-9f44-b04f027b9e22', 'c90a33f6-be65-4728-8d6a-8ef851312312', '455d175d-4224-4a47-888d-7ba3d706904e', '0badfdec-5ace-443c-b2f9-89ada9b93a8f', '32ce2ac0-b9d8-407c-953b-3fb9e726920a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:17 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:17 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:17 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4" returned: 0 in 0.435s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:17 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 1G Sep 23 00:38:17 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:17 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.285s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:17 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Deleted volume successfully. Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-fb81d916-f76b-4b97-b8fc-d3129d7209ff tempest-ProjectReaderTests-1092376017 None] Lock "cinder-d399adb6-36bd-43ae-a54e-4b5ae3ae6493-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:17 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 1G" returned: 0 in 0.453s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:17 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 Sep 23 00:38:17 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:18 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" returned: 0 in 0.312s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:18 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 is being set with open permissions: ugo+rw Sep 23 00:38:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:18 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 Sep 23 00:38:18 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:18 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" returned: 0 in 0.286s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:18 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info Sep 23 00:38:18 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:18 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info" returned: 0 in 0.305s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:18 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info is being set with open permissions: ugo+rw Sep 23 00:38:18 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:18 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info Sep 23 00:38:18 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:19 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.info" returned: 0 in 0.306s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:19 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:19 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-f39a380a-173c-4861-9d6d-0189e6dede2c tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-8be1558a-8ee5-4cc3-ba34-0f434e8cdc30-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Lock "cinder-8be1558a-8ee5-4cc3-ba34-0f434e8cdc30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-6f221a80-9041-4aff-9bc2-b984c8b593d4" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-6f221a80-9041-4aff-9bc2-b984c8b593d4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot 8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 of volume 6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb627cd3-971d-4514-8bb8-29e59b3c34e2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:20 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 Sep 23 00:38:20 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:20 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" returned: 0 in 0.382s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f221a80-9041-4aff-9bc2-b984c8b593d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db9657-caa4-4e4c-a95e-6d15dab05164]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:20 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:20 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 Sep 23 00:38:20 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:21 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4" returned: 0 in 0.420s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:21 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 Sep 23 00:38:21 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:21 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" returned: 0 in 0.403s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:21 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30 Sep 23 00:38:21 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:21 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4.8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" returned: 0 in 0.276s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-8be1558a-8ee5-4cc3-ba34-0f434e8cdc30" released by "_delete_snapshot" :: held 1.604s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-6f221a80-9041-4aff-9bc2-b984c8b593d4" released by "delete_snapshot" :: held 1.631s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:21 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Created reservations ['c6d4628b-bd08-4c45-815f-e159d7f5203c', '2b0afe1d-83a7-4069-88dc-561470c5d7f5', '71c9abfb-19f9-4cd9-8ba2-62a96e5eab41', 'a66c8597-9eb3-469b-b9be-95c2ab02bf34', '20ffce08-39b3-4f23-95ac-f54cd997966a'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:22 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-8aa4ca24-0f17-47dc-b897-e3052f021784 tempest-ProjectMemberTests-292579576 None] Lock "cinder-8be1558a-8ee5-4cc3-ba34-0f434e8cdc30-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-6f221a80-9041-4aff-9bc2-b984c8b593d4-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Lock "cinder-6f221a80-9041-4aff-9bc2-b984c8b593d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-6f221a80-9041-4aff-9bc2-b984c8b593d4" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-6f221a80-9041-4aff-9bc2-b984c8b593d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b1f23-16ee-4086-a6f2-7eff1ab06fc8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:22 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 Sep 23 00:38:22 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:22 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4" returned: 0 in 0.438s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:22 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:22 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4 Sep 23 00:38:22 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:23 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-6f221a80-9041-4aff-9bc2-b984c8b593d4" returned: 0 in 0.272s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-6f221a80-9041-4aff-9bc2-b984c8b593d4" released by "delete_volume" :: held 0.793s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Created reservations ['a47db18d-0950-493e-bc65-616941b285ba', 'c8fbfd04-7d4e-4087-8bc7-79dde2cd8e4c', '1b3ba7ad-63be-439d-ae01-9f784650b599', '5c899693-1b8f-482e-af5f-b7d3daec53fd', 'f8011751-48aa-47d1-af60-9faef2b52fe1'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:23 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:23 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:23 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.296s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:23 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:38:23 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-2a4f8b81-5d90-4ca1-b5af-97221aac1a45 tempest-ProjectMemberTests-292579576 None] Lock "cinder-6f221a80-9041-4aff-9bc2-b984c8b593d4-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.flows.manager.create_volume [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87292) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (f95bf97b-425b-41ca-9432-603b1a3c9f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638fd276-e2ec-4437-b99c-7d33a8ab5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638fd276-e2ec-4437-b99c-7d33a8ab5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095506405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9316406-cbfe-4f85-85ab-e572256ab918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:24Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49eff4f1-8219-4078-8684-0bbeaa6df4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49eff4f1-8219-4078-8684-0bbeaa6df4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c98cc34-8c0b-4903-9c04-f527bbc296f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c98cc34-8c0b-4903-9c04-f527bbc296f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9316406-cbfe-4f85-85ab-e572256ab918', 'volume_name': 'volume-d9316406-cbfe-4f85-85ab-e572256ab918', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496b5bdf-1477-4a62-93bf-ef527a833721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496b5bdf-1477-4a62-93bf-ef527a833721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460df6fe-c903-4b1e-9b98-30ccb9bc336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Volume d9316406-cbfe-4f85-85ab-e572256ab918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9316406-cbfe-4f85-85ab-e572256ab918', 'volume_size': 1} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095506405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9316406-cbfe-4f85-85ab-e572256ab918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f99f3453624926a8433e7fbdad5efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:24Z,use_quota=True,user_id='c9f6226926194babb9936a8b688d2453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197dc7ec-96da-493f-bb53-3ecbfe151dd9),volume_type_id=197dc7ec-96da-493f-bb53-3ecbfe151dd9)}" {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Creating volume d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Selected osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 as target Quobyte volume. {{(pid=87292) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:24 devstack cinder-volume[87292]: INFO cinder.volume.drivers.remotefs [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] casted to osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4 Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 1073741824 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:24 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 1073741824 Sep 23 00:38:24 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:24 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 1073741824" returned: 0 in 0.425s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:24 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 Sep 23 00:38:24 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:24 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918" returned: 0 in 0.282s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'} {{(pid=87292) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460df6fe-c903-4b1e-9b98-30ccb9bc336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9316406-cbfe-4f85-85ab-e572256ab918', 'volume_size': 1}' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4024a37-31de-488e-a9b0-f20adb227ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87292]: INFO cinder.volume.flows.manager.create_volume [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Volume volume-d9316406-cbfe-4f85-85ab-e572256ab918 (d9316406-cbfe-4f85-85ab-e572256ab918): created successfully Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4024a37-31de-488e-a9b0-f20adb227ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87292) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Flow 'volume_create_manager' (f95bf97b-425b-41ca-9432-603b1a3c9f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87292) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:24 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-53df996f-0c26-4820-8a9f-180b2962fee9 tempest-ProjectMemberTests-292579576 None] Created volume successfully. Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Creating offline snapshot aad89a11-7c98-4a73-a65e-2d634bc5ad36 of volume d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6a85a2-6da4-447b-a2ce-795adef6024c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:25 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 Sep 23 00:38:25 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:25 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918" returned: 0 in 0.413s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:25 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 1G {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:25 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 1G Sep 23 00:38:25 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:26 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 1G" returned: 0 in 0.398s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9316406-cbfe-4f85-85ab-e572256ab918 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:26 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9316406-cbfe-4f85-85ab-e572256ab918 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 Sep 23 00:38:26 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:26 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9316406-cbfe-4f85-85ab-e572256ab918 -F qcow2 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36" returned: 0 in 0.283s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:26 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 is being set with open permissions: ugo+rw Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:26 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 Sep 23 00:38:26 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:26 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36" returned: 0 in 0.266s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:26 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info Sep 23 00:38:26 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:26 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info" returned: 0 in 0.268s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:26 devstack cinder-volume[87292]: WARNING cinder.volume.drivers.remotefs [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info is being set with open permissions: ugo+rw Sep 23 00:38:26 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:27 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info Sep 23 00:38:27 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:27 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.info" returned: 0 in 0.259s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:27 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-181d8c30-533d-4131-b1f2-ea02ab33624d tempest-ProjectMemberTests-292579576 None] Create snapshot completed successfully Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-aad89a11-7c98-4a73-a65e-2d634bc5ad36-delete_snapshot" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Lock "cinder-aad89a11-7c98-4a73-a65e-2d634bc5ad36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-d9316406-cbfe-4f85-85ab-e572256ab918" by "delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d9316406-cbfe-4f85-85ab-e572256ab918" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-aad89a11-7c98-4a73-a65e-2d634bc5ad36" by "_delete_snapshot" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-aad89a11-7c98-4a73-a65e-2d634bc5ad36" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Deleting offline snapshot aad89a11-7c98-4a73-a65e-2d634bc5ad36 of volume d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] snapshot_file for this snap is: volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 {{(pid=87292) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44b2bc-ee4b-4669-ae40-f986e1280857]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:27 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:27 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 Sep 23 00:38:27 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36" returned: 0 in 0.437s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.remotefs [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9316406-cbfe-4f85-85ab-e572256ab918(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87292) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6a6d15-f3fe-4519-b41a-25649b3e6828]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 Sep 23 00:38:28 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918" returned: 0 in 0.400s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 Sep 23 00:38:28 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36" returned: 0 in 0.368s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:28 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36 Sep 23 00:38:28 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:29 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918.aad89a11-7c98-4a73-a65e-2d634bc5ad36" returned: 0 in 0.255s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-aad89a11-7c98-4a73-a65e-2d634bc5ad36" released by "_delete_snapshot" :: held 1.568s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d9316406-cbfe-4f85-85ab-e572256ab918" released by "delete_snapshot" :: held 1.593s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Created reservations ['b4c9b950-17a8-4dad-b3e0-4f576bce861d', '09c22580-38ea-41b2-844d-dc599f8ab528', 'b7fbfa3c-b6c6-40b7-ab10-e6c2310585cb', '16d57b72-f3f0-4718-90dd-e9151ae6970d', '9bef27ae-5d1c-4d58-a1a1-9b110f5b39ad'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:29 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Delete snapshot completed successfully. Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-42af56ef-05ed-4146-9cd8-8ee998f4808a tempest-ProjectMemberTests-292579576 None] Lock "cinder-aad89a11-7c98-4a73-a65e-2d634bc5ad36-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-d9316406-cbfe-4f85-85ab-e572256ab918-delete_volume" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Lock "cinder-d9316406-cbfe-4f85-85ab-e572256ab918-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Acquiring lock "cinder-quobyte-d9316406-cbfe-4f85-85ab-e572256ab918" by "delete_volume" {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d9316406-cbfe-4f85-85ab-e572256ab918" acquired by "delete_volume" :: waited 0.014s {{(pid=87292) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53082081-b51a-4791-9ff7-12846141eaf9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:29 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:29 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 Sep 23 00:38:29 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:30 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918" returned: 0 in 0.363s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:30 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918 Sep 23 00:38:30 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:30 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc/volume-d9316406-cbfe-4f85-85ab-e572256ab918" returned: 0 in 0.251s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Lock "cinder-quobyte-d9316406-cbfe-4f85-85ab-e572256ab918" released by "delete_volume" :: held 0.674s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG cinder.quota [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Created reservations ['442a4e7d-873f-4693-9b26-2d88732f4b1c', '966b302c-e751-41c4-a102-3324b2e37da3', 'c2a70a44-9ecb-4fc0-afa4-8b27bd54f461', '1a393cc6-2ce4-4d44-84cb-f6305325bb59', '290116f7-25b0-4454-b415-4766bc04ee44'] {{(pid=87292) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:30 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:30 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:30 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.263s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:30 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Deleted volume successfully. Sep 23 00:38:30 devstack cinder-volume[87292]: DEBUG cinder.coordination [None req-4342002f-7d3c-4363-90c2-86e0c54dfcca tempest-ProjectMemberTests-292579576 None] Lock "cinder-d9316406-cbfe-4f85-85ab-e572256ab918-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87292) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:40 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=129,cinder:INSERT=48,cinder:UPDATE=158,cinder:DELETE=9 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:40 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=108,cinder:INSERT=42,cinder:UPDATE=143,cinder:DELETE=12 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4': None} {{(pid=87292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG cinder.volume.drivers.quobyte [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc5b2530-6ce9-4277-8f02-5f77c0ca1ae4'] {{(pid=87292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:55 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc Sep 23 00:38:55 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:55 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_concurrency.processutils [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c079042164db3270460e8e90da7c7adc" returned: 0 in 0.249s {{(pid=87292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG cinder.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Notifying Schedulers of capabilities ... {{(pid=87292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG oslo_service.periodic_task [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] Running periodic task VolumeManager._thread_info {{(pid=87292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread count: 28 {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:38:55 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-244a0c4f-2aa5-4519-a898-a8dc9ec9c1ef None None] thread info: [<_MainThread(MainThread, started 137539252592768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:39:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:39:03 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:UPDATE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}